-- Logs begin at Tue 2022-05-17 14:49:33 UTC, end at Tue 2022-05-17 16:12:17 UTC. -- May 17 15:33:06.568700 dv-cinder-842128-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 15:33:06.576104 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 15:33:06 2022] *** May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: nodename: dv-cinder-842128-1-iscsi May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: machine: x86_64 May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: clock source: unix May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: pcre jit disabled May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: detected number of CPU cores: 4 May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: current working directory: / May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: detected binary path: /usr/bin/uwsgi-core May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: your processes number limit is 47680 May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: your memory page size is 4096 bytes May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: detected max file descriptor number: 2048 May 17 15:33:06.579245 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: lock engine: pthread robust mutexes May 17 15:33:06.580029 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: thunder lock: enabled May 17 15:33:06.580029 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 15:33:06.580029 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 15:33:06.624192 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: Python main interpreter initialized at 0x556f4b2a79c0 May 17 15:33:06.624192 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: python threads support enabled May 17 15:33:06.624192 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: your server socket listen backlog is limited to 100 connections May 17 15:33:06.624192 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: your mercy for graceful operations on workers is 90 seconds May 17 15:33:06.624543 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: mapped 403077 bytes (393 KB) for 2 cores May 17 15:33:06.624618 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: *** Operational MODE: preforking *** May 17 15:33:06.624863 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: *** uWSGI is running in multiple interpreter mode *** May 17 15:33:06.624863 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: spawned uWSGI master process (pid: 109557) May 17 15:33:06.625049 dv-cinder-842128-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 15:33:06.625694 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: spawned uWSGI worker 1 (pid: 109558, cores: 1) May 17 15:33:06.626996 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: spawned uWSGI worker 2 (pid: 109559, cores: 1) May 17 15:33:06.626996 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 15:33:07.821414 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 15:33:07.842838 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 15:33:08.553057 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:33:08.553057 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: from cryptography.utils import int_from_bytes May 17 15:33:08.553324 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:33:08.553324 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: from cryptography.utils import int_from_bytes May 17 15:33:08.557572 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:33:08.557572 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: from cryptography.utils import int_from_bytes May 17 15:33:08.557897 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:33:08.557897 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: from cryptography.utils import int_from_bytes May 17 15:33:11.167244 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 15:33:11.167669 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 15:33:11.168011 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 15:33:11.168371 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 15:33:11.168624 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 15:33:11.168815 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 15:33:11.169170 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.169275 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 15:33:11.169362 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.169596 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 15:33:11.169709 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.169930 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.170043 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 15:33:11.170233 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 15:33:11.170327 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.170587 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.170697 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.170905 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.170997 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.171223 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.171319 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.171550 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.171642 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.171816 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.171931 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.172126 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.172230 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.172448 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842128-1-iscsi {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.172539 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.172771 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.172861 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.173078 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.173175 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.173403 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.173495 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.173704 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.173794 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174029 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174137 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842128-1-iscsi {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174354 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174439 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174659 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174757 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.174983 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.175150 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.175322 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176293 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176428 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176552 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176652 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176738 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176822 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.176902 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.177515 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.177617 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.177753 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.177841 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.177921 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.178092 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.178227 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.178407 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.178501 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.178732 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.178866 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.179041 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.179140 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.179431 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.179516 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842128-1-iscsi {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.179749 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.179851 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.180059 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.180151 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.180373 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.180493 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.180770 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842128-1-iscsi {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.180909 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.181085 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.181168 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.181393 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.181498 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.181711 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.181811 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.182049 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.182155 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.182359 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.182450 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.182682 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183000 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183099 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183318 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183427 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183634 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183726 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.183936 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184032 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184244 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184334 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184557 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184642 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184874 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.184962 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.185180 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.185271 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.185484 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.185579 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.185748 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.185837 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.186052 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.186159 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.186376 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.186467 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.186694 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.186780 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187012 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187096 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187260 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187359 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187508 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187650 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187825 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.187962 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.188143 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.188293 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.188451 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.188536 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.188758 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.188844 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189064 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189157 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189371 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189457 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189678 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189777 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.189987 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.190118 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.190312 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.190405 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.190617 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.190714 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.190934 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191030 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191244 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191338 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191558 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191658 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191864 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.191947 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.192182 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.192267 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.192498 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.192590 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.193375 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.193461 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.193687 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.193771 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194030 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194136 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194363 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194447 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194673 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194765 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.194987 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.195085 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.195306 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.195396 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.195614 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.195712 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.195919 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196018 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196227 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196317 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196546 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196642 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196863 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.196954 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.197164 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.197253 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.197414 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.197504 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.197714 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.197799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198036 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198138 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198357 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198449 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198665 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198751 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.198971 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199055 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199369 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199579 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199670 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199884 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.199991 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.200194 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.200306 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.200500 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.200592 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.200804 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.200894 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.201108 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.201204 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.201412 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.201497 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.201720 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.201813 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202056 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202164 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202353 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202438 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202661 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202745 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.202977 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203075 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203283 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203372 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203587 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203684 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203894 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.203981 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.204198 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.204291 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.204520 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.204605 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.204823 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.204915 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.205131 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.205217 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.205441 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.205526 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.205745 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.205847 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.206073 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.206161 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.206392 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.206486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.206699 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.206796 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207005 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207098 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207315 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207399 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207613 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207697 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.207920 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.208015 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.208283 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.208368 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.208638 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.208723 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.208944 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209034 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209248 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209332 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209553 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209653 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209859 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.209951 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.210204 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.210344 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.210498 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.210585 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.210801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.210895 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.211102 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.211196 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.211409 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.211500 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.211723 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.211814 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212035 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212128 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212341 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212433 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212666 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212760 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.212995 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.213156 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.213314 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.213407 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.213630 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.213720 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.213943 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.214297 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:33:11.214384 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.214641 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.214739 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.214971 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.215055 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.215294 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.215386 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.215609 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.215732 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.215928 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216014 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216253 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216338 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216567 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216652 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216880 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.216966 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.217191 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.217286 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.217511 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.217604 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.217830 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.217914 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.218179 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.218266 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.218503 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.218616 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.218831 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.218925 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.219158 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.219245 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.219739 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.219839 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.220060 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.220157 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.220389 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.220473 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.220710 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.220802 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.221023 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.221116 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.221346 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.221440 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.221685 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.221792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222027 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222158 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222343 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222437 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222668 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222762 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.222983 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.223067 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.223294 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.223378 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.223604 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.223691 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.223963 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.224053 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.224291 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.224382 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.224607 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.224691 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.224921 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225012 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225232 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225315 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225547 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225643 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225860 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.225946 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.226208 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.226297 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.226521 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.226608 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.226841 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.226933 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.227156 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.227239 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.227471 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.227556 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.227784 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.227868 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.228101 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.228202 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.228414 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.228506 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.228725 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.228821 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229037 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229131 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229343 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229427 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229648 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229733 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.229953 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.230489 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.230624 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.230732 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.230836 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.230958 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231067 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231180 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231180 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231393 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231497 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231599 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231785 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.231909 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.232089 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.232200 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.232399 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.232512 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.232709 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.232822 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235120 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235240 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235326 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235406 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235501 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235583 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235668 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235768 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235850 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.235975 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236079 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236168 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236253 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236332 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236417 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236503 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236582 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236660 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236737 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236823 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.236902 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237065 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237149 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237227 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237304 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237382 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237459 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237544 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237623 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237700 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237784 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237870 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.237956 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238072 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238155 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238233 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238424 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238554 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238760 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.238873 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.239092 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.239205 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.239396 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.240058 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.240256 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.240402 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.240586 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.240722 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.240903 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.241033 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.241209 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.241336 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.241518 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.241672 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.241823 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.242044 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.242153 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.242374 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.242459 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.242689 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.242776 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243010 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243096 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243320 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243468 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243623 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243710 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.243927 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244020 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244230 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244315 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244538 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244631 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244848 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.244935 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.245148 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.245233 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.245452 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.245549 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.245755 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.245842 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.246104 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.246191 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.246419 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.246513 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.246728 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.246813 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.247039 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.247134 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.247352 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.247447 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.247691 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.247786 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248001 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248097 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248311 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248404 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248620 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248705 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.248933 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249018 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249245 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249339 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249555 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249654 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249875 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.249960 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.250212 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.250307 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.250530 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.250622 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.250838 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.250923 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.251161 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.251247 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.251472 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.251557 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.251786 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.251869 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.252089 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.252175 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.252405 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.252490 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.252732 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.252815 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253050 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253146 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253454 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253554 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253675 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253768 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.253985 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.254098 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.254321 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.254407 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.254632 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.254730 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.254949 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.255034 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.255821 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.255915 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.256137 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.256237 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.256458 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.256551 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.256772 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.256857 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.257088 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.257184 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.257398 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.257483 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.257713 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.257810 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258036 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258137 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258360 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258446 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258664 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258757 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.258979 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.259072 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.259304 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.259390 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.259618 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.259712 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.259931 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260017 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260243 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260326 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260558 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260641 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260867 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.260953 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.261175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.261262 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.261484 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.261569 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.261787 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.261882 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.262112 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.262200 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.262423 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.262520 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.262738 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.262824 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263045 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263138 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263354 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263595 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263687 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263776 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.263953 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264040 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264261 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264356 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264563 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264649 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264875 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.264967 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.265182 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.265275 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.265522 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.265636 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.265811 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.265914 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.266141 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.266307 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.266455 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.266542 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.266757 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.266849 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267060 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267147 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267380 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267464 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267688 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267773 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.267992 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.268084 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.268294 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.268379 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.268598 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.268682 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.268921 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269020 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269231 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269316 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269537 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269623 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269842 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.269928 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.270178 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.270267 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.270485 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.270586 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.270823 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.270979 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.271132 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.271353 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.271446 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.271681 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.271769 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272010 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272104 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272328 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272413 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272632 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272718 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.272942 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273029 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273251 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273337 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273563 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273673 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273877 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.273974 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.274207 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.274312 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.274516 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.274601 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.274829 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.274913 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.275132 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.275227 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.275441 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.275535 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.275755 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.275842 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.276069 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.276326 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.276458 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.276658 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.276745 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.276973 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.277060 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.277288 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.277374 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.277603 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.277688 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.277920 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.278197 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.278286 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.278539 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.278627 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.278862 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.278947 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.279190 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.279290 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.279498 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.279589 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.279803 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.279890 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.280106 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.280200 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.280413 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.280508 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.280718 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.280803 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281020 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281118 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281321 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281409 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281628 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281714 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.281932 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282128 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282274 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282410 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282555 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282688 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282834 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.282952 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.283143 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.283264 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.283444 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.283580 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.283753 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.283898 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284044 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284209 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284364 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284523 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284670 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284834 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.284975 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.285152 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.285277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.285459 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.285578 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.285776 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.285916 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.286110 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.286246 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.287013 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.287485 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.287582 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.287939 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.288292 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.288376 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.288642 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.288726 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.288956 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289042 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289265 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289351 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289593 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289687 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289902 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.289988 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.290235 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.290321 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.290543 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.290644 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.290858 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.290943 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.291170 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.291256 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.291475 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.291638 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.291785 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.291878 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.292097 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.292188 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.292408 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.292494 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.292716 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.292800 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293019 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293113 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293328 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293414 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293629 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293722 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.293947 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294066 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294283 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294381 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294587 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294682 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294890 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.294976 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.295198 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.295284 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.295502 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.295585 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.295805 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.295890 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.296119 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.296206 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.296422 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.296514 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.296735 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.296828 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297038 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297134 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297339 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297424 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297643 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297747 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.297950 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298080 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298282 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298367 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298589 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298684 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298898 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.298982 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.299209 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.299295 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.299510 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.299608 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.299814 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.299908 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.300122 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.300207 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.300455 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.300549 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.300776 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.300863 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.301085 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.301169 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.301396 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.301490 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.301714 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.301800 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.302098 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.302689 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.302932 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.303029 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.303252 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.303347 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.303583 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.303668 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.303961 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304069 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304228 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304395 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304538 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304685 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304821 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.304964 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305100 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305235 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305369 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305521 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305658 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305792 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.305964 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.306129 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.306302 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.306451 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.306607 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.306744 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.306912 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307051 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307215 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307317 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307542 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307636 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307851 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.307962 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.308162 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.308264 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.308474 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.308569 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.308798 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.308953 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.309145 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.309310 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.309460 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.309623 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.309828 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.309922 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.310166 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.310255 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.310493 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.310578 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.310820 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.310917 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.311141 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.311228 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.311450 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.311533 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.311753 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.311849 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.312058 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.312150 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.312375 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.312460 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.312682 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.312780 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313001 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313099 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313311 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313397 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313622 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313724 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.313952 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.314204 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.314280 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.314440 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.314615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.314782 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.314921 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315053 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315226 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315327 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315558 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315654 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315870 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.315956 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.316187 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.316274 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.316506 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.316592 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.316819 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.316902 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.317131 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.317261 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.317443 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.317530 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.317875 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.318134 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.318322 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.318451 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.318655 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.318764 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.319022 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.319158 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.319351 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.319483 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.319702 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.319796 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320041 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320126 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320363 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320457 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320664 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320748 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.320974 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.321058 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.321277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.321439 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.321609 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.321701 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.321925 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.322036 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.322265 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.322369 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.322586 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.322671 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.322932 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.323016 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.323243 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.323397 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.323557 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.323719 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.323870 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324040 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324225 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324356 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324593 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324702 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324900 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.324986 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.325210 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.325298 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.325518 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.325611 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.325819 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.325904 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.326146 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.326334 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.326454 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.326653 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.326780 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.326972 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.327072 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.327291 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.327424 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.327602 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.327690 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.327914 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328007 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328232 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328317 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328553 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328638 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328867 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.328952 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.329180 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.329272 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.329492 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.329578 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.329822 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.329942 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.330155 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.330277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.330483 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.330586 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.330890 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.330984 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.331207 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.331292 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.331519 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.331619 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.331819 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.331940 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.332130 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.332259 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.332438 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.332576 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.332760 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.332906 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.333081 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.333268 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.333458 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.333608 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.333776 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.333922 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.334104 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.334280 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.334428 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.334650 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.334750 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.334915 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.335046 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.335245 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.335365 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.335563 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.335777 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.335873 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.336098 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.336191 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.336419 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.336505 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.336750 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.336837 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337074 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337167 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337379 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337510 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337683 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337834 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.337989 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.338190 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.338315 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.338510 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.338606 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.338845 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.338932 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.339177 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.339265 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.339490 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.339579 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.339800 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.339886 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.340105 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.340191 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.340409 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.340499 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.340712 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.340798 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341035 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341128 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341336 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341422 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341654 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341738 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.341964 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.342068 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.342299 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.342393 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.342613 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.342699 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.342925 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343246 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343334 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343554 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343638 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343854 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.343947 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.344157 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.344242 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.344784 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.344893 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345049 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345149 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345353 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345447 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345672 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345758 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.345993 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.346132 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.346327 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.346414 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.346638 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.346724 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.346950 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347279 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347363 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347595 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347682 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347912 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.347999 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.348238 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.348324 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.348544 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.348643 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.349356 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.349459 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.349670 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.349757 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.349977 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.350175 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.350305 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.350393 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.350610 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.350696 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.350917 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351010 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351221 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351315 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351525 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351609 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351829 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.351924 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.352151 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.352236 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.352455 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.352541 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.352776 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.352870 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.353083 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.353170 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.353387 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.353472 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.353690 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.353784 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354013 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354132 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354349 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354462 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354648 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354742 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.354976 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.355070 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.355297 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.355393 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.355610 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.355706 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.355922 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356018 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356228 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356329 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356550 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356646 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356865 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.356961 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.357185 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.357287 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.357499 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.357621 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.357814 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.357909 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.358163 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.358271 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.358479 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.358573 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.358791 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.358885 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.359097 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.359201 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.359412 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.359507 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.359725 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.359829 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.360042 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.360147 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.360360 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.360605 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.360708 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.360935 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.361038 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.361251 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.361353 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.361562 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.361658 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.361872 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.362043 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.362209 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.362313 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.362523 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.362779 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.362874 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.363124 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.363228 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.363428 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.363523 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.363736 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.363833 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.364062 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.364164 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.364381 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.364582 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.365254 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.365370 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.365577 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.365674 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.365898 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.365993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.366238 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.366346 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.366556 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.366650 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.366869 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.366962 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.367207 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.367311 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.367534 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.367628 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.367843 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.367937 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.368157 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.368253 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.368473 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.368577 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.368787 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.368885 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.369098 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.369202 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.369414 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.369728 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.369846 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.370092 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.370208 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.370327 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.370436 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.370636 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.370950 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.371051 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.371262 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.371584 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.371916 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.372099 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.372223 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.372435 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.372532 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.372763 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.372867 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.373089 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.373200 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.373415 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.373636 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.373751 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.373959 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.374075 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.374330 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.374426 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.374661 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.374758 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.374988 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.375092 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.375355 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.375456 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.375621 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.375718 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.375953 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376062 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376263 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376367 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376570 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376666 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376886 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.376996 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.377197 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.377412 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.377517 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.377738 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.377833 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.378104 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.378203 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.378422 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.378516 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.378742 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.378884 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.379050 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.379186 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.379378 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.379582 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.379717 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.379932 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.380076 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.380294 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.380430 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.380623 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.380934 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.381097 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.381237 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.381497 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.381628 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.381877 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.382095 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.382243 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.382659 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.382793 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.383216 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.383346 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.383554 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.383758 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.383891 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.384213 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.384350 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.384565 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.384893 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.385077 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.385206 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.385501 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.385648 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.385778 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.385921 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.386225 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.386370 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.386565 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.386696 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.387073 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.387219 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.387616 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.387751 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.388154 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.388285 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.388637 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.388776 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.388965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.389096 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.389286 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.389416 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.389603 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.389734 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.389916 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.390078 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.390266 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.390402 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.390580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.390716 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.390896 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391037 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391205 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391355 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391522 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391660 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391832 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.391968 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.392146 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.392280 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.392471 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.392607 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.392791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.392927 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.393109 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.393265 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.393405 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.393544 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.393765 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.393909 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394213 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394348 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394480 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394659 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394795 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.394972 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.395117 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.395282 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.395425 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.395682 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.395818 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.395952 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.396173 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.396313 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.396509 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.396644 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.396836 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.396979 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.397171 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.397305 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.397504 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.397641 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.397818 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.397965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.398214 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.398350 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.398545 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.398690 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.398867 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399007 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399199 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399334 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399524 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399676 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399839 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.399983 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.400153 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.400288 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.400465 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.400607 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.400778 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.401030 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.401161 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.401379 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.401520 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.401686 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.401829 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402017 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402153 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402328 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402457 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402638 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402783 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.402950 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.403082 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.403291 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.403422 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.403611 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.403763 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.403930 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.404071 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.404247 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.404381 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.404562 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.404697 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.404880 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405012 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405190 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405330 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405501 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405778 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405869 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.405948 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.406141 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.406232 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.406462 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.406550 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.406779 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.406866 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.407084 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.407178 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.407410 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.407496 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.407733 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.407819 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.408082 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.408177 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.408412 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.408499 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.408728 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.408813 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.409051 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.409146 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.409371 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.409457 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.409685 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.409772 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410102 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410195 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410347 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410432 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410668 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410755 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.410995 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.411094 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.411853 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.411947 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.412182 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.412267 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.412500 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.412593 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.412810 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.412927 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.413116 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.413250 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.413429 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.413581 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.413747 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.413913 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.414187 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.414292 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.414499 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.414586 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.414807 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.414900 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.415120 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.415215 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.415428 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.415514 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.415837 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.415938 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416028 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416155 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416332 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416503 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416643 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416842 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.416942 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.417178 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.417272 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.417496 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.417582 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.417811 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.417908 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.418143 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.418243 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.418452 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.418541 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.418766 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.418862 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419071 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419157 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419379 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419465 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419685 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419772 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.419991 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.420077 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.420297 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.420382 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.420609 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.420695 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.420924 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421010 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421238 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421325 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421558 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421644 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421868 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.421953 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.422207 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.422304 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.422516 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.422601 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.422823 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.422911 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.423136 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.423231 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.423450 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.423537 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.423758 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.423849 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.424093 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.424188 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.424404 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.424490 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.424715 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.424807 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425029 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425125 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425426 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425653 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425747 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.425967 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.426113 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.426317 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.426405 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.426644 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.426742 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.426971 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.427066 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.427833 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.427919 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.428234 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.428326 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.428563 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.428654 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.428886 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.428974 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.429203 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.429289 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.429519 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.429606 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.429837 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.429922 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.430175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.430276 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.430494 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.430581 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.430805 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.430904 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.431119 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.431219 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.431435 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.431530 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.431748 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.431834 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.432076 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.432171 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.432406 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.432501 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.432718 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.432804 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.433043 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.433129 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.433366 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.433460 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.433697 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.433791 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.434052 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.434154 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.434352 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.434437 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.434692 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.434781 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435007 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435102 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435321 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435413 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435624 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435710 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.435868 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 15:33:11.436061 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.436253 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.436578 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.436903 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.437238 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.437572 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.437890 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.438255 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.438589 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.438945 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.439266 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.439617 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.439959 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.440282 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.440603 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.440916 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:33:11.441163 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109559) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 15:33:11.462551 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_db.sqlalchemy.engines [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.463818 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_db.sqlalchemy.engines [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.524653 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.context [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91629321-da27-4ee4-9a78-15344e4578f9(cell1) {{(pid=109558) load_cells /opt/stack/nova/nova/context.py:464}} May 17 15:33:11.528359 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.context [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91629321-da27-4ee4-9a78-15344e4578f9(cell1) {{(pid=109559) load_cells /opt/stack/nova/nova/context.py:464}} May 17 15:33:11.529010 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:33:11.530632 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:33:11.531417 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:33:11.532677 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_concurrency.lockutils [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:33:11.533354 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:33:11.534301 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_concurrency.lockutils [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:33:11.535106 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_concurrency.lockutils [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:33:11.537095 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_concurrency.lockutils [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109559) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:33:11.543868 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_db.sqlalchemy.engines [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.547534 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_db.sqlalchemy.engines [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.554612 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_db.sqlalchemy.engines [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.555452 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_db.sqlalchemy.engines [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.706673 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_db.sqlalchemy.engines [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:11.716401 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG oslo_db.sqlalchemy.engines [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109559) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:33:12.046645 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: WARNING keystonemiddleware.auth_token [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:33:12.048059 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: WARNING keystonemiddleware.auth_token [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:33:12.054025 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: WARNING keystonemiddleware.auth_token [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:33:12.056382 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: WARNING keystonemiddleware.auth_token [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:33:12.398183 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: WARNING keystonemiddleware.auth_token [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:33:12.404021 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: WARNING keystonemiddleware.auth_token [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:33:12.404397 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: WARNING keystonemiddleware.auth_token [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:33:12.410383 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f4b2a79c0 pid: 109558 (default app) May 17 15:33:12.411051 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: WARNING keystonemiddleware.auth_token [None req-8f43caff-c513-4776-a430-f9185c5709e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:33:12.413005 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:33:12.414207 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001751 May 17 15:33:12.414880 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Tue May 17 15:33:12 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:33:12.416729 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f4b2a79c0 pid: 109559 (default app) May 17 15:34:30.178058 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:30.179098 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 17 15:34:30.179502 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:30.602670 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-30d3390a-811f-4170-8f39-26cd9a852831 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:30.632304 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-30d3390a-811f-4170-8f39-26cd9a852831 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446267 May 17 15:34:30.638042 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1291 bytes} [Tue May 17 15:34:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:32.899267 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:32.900486 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-36645aea-cd38-4822-be1c-d01f2d61e4fa None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 May 17 15:34:32.901162 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:32.964695 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-5389c145-f85c-4519-8725-3fbd663bc81a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:32.983869 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:34:32.983869 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: warnings.warn(msg) May 17 15:34:33.013094 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-5389c145-f85c-4519-8725-3fbd663bc81a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105896 May 17 15:34:33.014057 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 15:34:33.246296 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-b32234cb-5067-4a74-9311-a9d51d525514 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:33.248725 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:34:33.248725 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: warnings.warn(msg) May 17 15:34:33.296759 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-b32234cb-5067-4a74-9311-a9d51d525514 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.274917 May 17 15:34:33.297688 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1335 bytes} [Tue May 17 15:34:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:35.579418 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-5389c145-f85c-4519-8725-3fbd663bc81a admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:35.580463 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-5389c145-f85c-4519-8725-3fbd663bc81a admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 17 15:34:35.580865 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:35.705976 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-9dd0fb0b-26b3-4913-8147-57009780085f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 5, "id": "d1", "ram": 512}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:35.724436 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:34:35.724436 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: warnings.warn(msg) May 17 15:34:35.743942 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-9dd0fb0b-26b3-4913-8147-57009780085f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157102 May 17 15:34:35.744602 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:35.756453 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-eea58991-219c-49d8-9472-cb966e808b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:35.758076 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:34:35.758076 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: warnings.warn(msg) May 17 15:34:35.789241 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-eea58991-219c-49d8-9472-cb966e808b74 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036448 May 17 15:34:35.789740 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1335 bytes} [Tue May 17 15:34:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:38.054132 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-9dd0fb0b-26b3-4913-8147-57009780085f admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:38.055149 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-9dd0fb0b-26b3-4913-8147-57009780085f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 17 15:34:38.055715 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:38.136847 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-833045ef-36e2-4075-95bd-8e65768498e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:38.159903 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-833045ef-36e2-4075-95bd-8e65768498e1 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097723 May 17 15:34:38.162052 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:38.172650 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-1793e1c4-f7c2-4919-a08e-1219899d524a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:38.197437 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-1793e1c4-f7c2-4919-a08e-1219899d524a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028623 May 17 15:34:38.198067 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1335 bytes} [Tue May 17 15:34:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:40.468189 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-833045ef-36e2-4075-95bd-8e65768498e1 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:40.469503 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-833045ef-36e2-4075-95bd-8e65768498e1 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 May 17 15:34:40.469942 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:40.541472 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-8c483f2a-decb-4a78-9ade-48b5831583f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "swap": 0, "name": "ds2G"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:40.561752 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-8c483f2a-decb-4a78-9ade-48b5831583f4 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085350 May 17 15:34:40.562480 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:40.574547 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-05079722-a371-4bd5-9625-28c80eea8424 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:40.600487 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-05079722-a371-4bd5-9625-28c80eea8424 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029620 May 17 15:34:40.601284 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1335 bytes} [Tue May 17 15:34:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:34:42.931593 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-8c483f2a-decb-4a78-9ade-48b5831583f4 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:42.932815 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-8c483f2a-decb-4a78-9ade-48b5831583f4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 May 17 15:34:42.933214 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:42.992750 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-b6ff9647-3976-4862-ae5d-6fdf40eea14f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:43.011274 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-b6ff9647-3976-4862-ae5d-6fdf40eea14f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072049 May 17 15:34:43.011886 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:43.024346 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-b0cfbfd8-9e96-41fb-ac19-c00ccf87ccfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:43.049279 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-b0cfbfd8-9e96-41fb-ac19-c00ccf87ccfb admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027881 May 17 15:34:43.054278 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1335 bytes} [Tue May 17 15:34:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:34:45.295501 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-b6ff9647-3976-4862-ae5d-6fdf40eea14f admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:45.296518 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-b6ff9647-3976-4862-ae5d-6fdf40eea14f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 17 15:34:45.296919 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:45.358888 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-38102933-1635-4ccb-929e-9d22b61f294f admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:45.384696 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-38102933-1635-4ccb-929e-9d22b61f294f admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081078 May 17 15:34:45.392341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1291 bytes} [Tue May 17 15:34:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:34:47.656290 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-b6ff9647-3976-4862-ae5d-6fdf40eea14f admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:47.657862 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-b6ff9647-3976-4862-ae5d-6fdf40eea14f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 17 15:34:47.658349 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:47.722876 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-39460f89-d94b-428a-bfc2-44f577ec602e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "name": "m1.tiny", "id": "1"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:47.750287 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-39460f89-d94b-428a-bfc2-44f577ec602e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085801 May 17 15:34:47.751050 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:47.762930 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-0cf9aa04-bfe4-492e-87e6-ec1ce9db78e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:47.789323 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-0cf9aa04-bfe4-492e-87e6-ec1ce9db78e4 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029979 May 17 15:34:47.790370 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1332 bytes} [Tue May 17 15:34:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:34:50.061922 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-39460f89-d94b-428a-bfc2-44f577ec602e admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:50.063307 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-39460f89-d94b-428a-bfc2-44f577ec602e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 May 17 15:34:50.064529 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:50.136202 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-9b58ea4a-1590-4234-be8d-ccb26202de32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:50.153195 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-9b58ea4a-1590-4234-be8d-ccb26202de32 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081518 May 17 15:34:50.153778 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 15:34:50.165318 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-5600d5c1-e9ba-4fa9-a4ed-6e853e7319aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:50.187938 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-5600d5c1-e9ba-4fa9-a4ed-6e853e7319aa admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026274 May 17 15:34:50.188564 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1332 bytes} [Tue May 17 15:34:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:52.928551 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-9b58ea4a-1590-4234-be8d-ccb26202de32 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:52.929631 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-9b58ea4a-1590-4234-be8d-ccb26202de32 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 17 15:34:52.930054 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:52.987116 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-a951104a-1c87-4731-aebb-64a2f5a1cdba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:53.004605 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-a951104a-1c87-4731-aebb-64a2f5a1cdba admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068674 May 17 15:34:53.005149 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:53.017262 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1edbcdd0-4405-4937-be7a-7010e34110c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:53.038809 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-1edbcdd0-4405-4937-be7a-7010e34110c8 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025310 May 17 15:34:53.039467 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1332 bytes} [Tue May 17 15:34:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:55.305311 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-a951104a-1c87-4731-aebb-64a2f5a1cdba admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:55.306353 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-a951104a-1c87-4731-aebb-64a2f5a1cdba admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 17 15:34:55.306757 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:55.365204 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-031cece1-0517-447c-b27b-4cc6d56e8e7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:55.384301 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-031cece1-0517-447c-b27b-4cc6d56e8e7e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071594 May 17 15:34:55.384860 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:55.396462 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-eb47e5ed-191a-447a-9eeb-f8c6d8fb63d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:55.421283 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-eb47e5ed-191a-447a-9eeb-f8c6d8fb63d4 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028459 May 17 15:34:55.421864 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1332 bytes} [Tue May 17 15:34:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:34:57.743744 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-031cece1-0517-447c-b27b-4cc6d56e8e7e admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:34:57.745296 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-031cece1-0517-447c-b27b-4cc6d56e8e7e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001887 May 17 15:34:57.745907 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:34:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:34:57.815216 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-03e12bea-1ce2-4502-95a6-1541f0dc2179 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "swap": 0, "id": "5", "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:57.836870 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-03e12bea-1ce2-4502-95a6-1541f0dc2179 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081515 May 17 15:34:57.837527 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1282 bytes} [Tue May 17 15:34:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:34:57.849866 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-57f07a70-e1a7-42ac-a974-16f0cddcea08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:34:57.877810 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-57f07a70-e1a7-42ac-a974-16f0cddcea08 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031554 May 17 15:34:57.878792 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1332 bytes} [Tue May 17 15:34:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:35:21.838089 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-03e12bea-1ce2-4502-95a6-1541f0dc2179 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:21.839089 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-03e12bea-1ce2-4502-95a6-1541f0dc2179 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 17 15:35:21.839482 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:21.895909 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-9f0a53d4-a9ee-4140-9099-dfe54219118c admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:21.912807 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-9f0a53d4-a9ee-4140-9099-dfe54219118c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066823 May 17 15:35:21.913335 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1291 bytes} [Tue May 17 15:35:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:22.918511 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-03e12bea-1ce2-4502-95a6-1541f0dc2179 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:22.919515 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-03e12bea-1ce2-4502-95a6-1541f0dc2179 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 17 15:35:22.919918 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:23.120651 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1e684556-8369-498e-836b-e02637ee3df3 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:23.126750 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.wsgi [None req-1e684556-8369-498e-836b-e02637ee3df3 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1e684556-8369-498e-836b-e02637ee3df3 admin admin] Request method failure captured: May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Accept: application/json May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Accept-Encoding: gzip, deflate May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Connection: keep-alive May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Content-Length: 0 May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Host: 10.222.0.75 May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Openstack-Api-Version: compute 2.90 May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Openstack-System-Scope: None May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: User-Agent: python-novaclient May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Auth-Token: gAAAAABig8C6WeOW1C5se0bJuT0xYzAgmYpLYxZCx8x9GZWYTHdlWqsINGczVO73wIV8BTudyN_Kk3DA4ligCe6XcjJX8uoN4BOvIVxgZGitJzE5iGvSOaEhGHYSm0Em7ihh6_s4nQsXv1d6hPflaFQR3NpIqEscbIHVtIHbIx82LprES2smlDo May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Domain-Id: None May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Domain-Name: None May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Identity-Status: Confirmed May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Is-Admin-Project: True May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Openstack-Nova-Api-Version: 2.90 May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Domain-Id: default May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Domain-Name: Default May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Name: admin May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Role: reader,admin,member May 17 15:35:23.130023 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Roles: reader,admin,member May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_519a641cdee343408fe589d891a54066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/519a641cdee343408fe589d891a54066"}]}] May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant: admin May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant-Name: admin May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User: admin May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Domain-Id: default May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Domain-Name: Default May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Id: 2ee5e213008a431f98430b648aa9d659 May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Name: admin May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: method: > May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: exception: Flavor 42 could not be found. May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: action_args: {'id': '42'} May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:35:23.131486 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:23.132387 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:23.133615 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1e684556-8369-498e-836b-e02637ee3df3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:35:23.134743 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-1e684556-8369-498e-836b-e02637ee3df3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064546 May 17 15:35:23.134743 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Tue May 17 15:35:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 15:35:23.141060 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-bc8386c8-46a5-4e6c-adc8-77741aa40f8f admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:23.162597 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-bc8386c8-46a5-4e6c-adc8-77741aa40f8f admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025090 May 17 15:35:23.163142 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Tue May 17 15:35:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:23.172724 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-8ec2575f-a78f-465e-a849-2fb8265c93ab admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:23.194502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-8ec2575f-a78f-465e-a849-2fb8265c93ab admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025391 May 17 15:35:23.195024 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Tue May 17 15:35:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:23.203943 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-3291c5f3-bd88-4532-abe8-13c569a38baa admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:23.209231 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.wsgi [None req-3291c5f3-bd88-4532-abe8-13c569a38baa admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-3291c5f3-bd88-4532-abe8-13c569a38baa admin admin] Request method failure captured: May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Accept: application/json May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Accept-Encoding: gzip, deflate May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Connection: keep-alive May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Content-Length: 0 May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Host: 10.222.0.75 May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Openstack-Api-Version: compute 2.90 May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Openstack-System-Scope: None May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: User-Agent: python-novaclient May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Auth-Token: gAAAAABig8C6WeOW1C5se0bJuT0xYzAgmYpLYxZCx8x9GZWYTHdlWqsINGczVO73wIV8BTudyN_Kk3DA4ligCe6XcjJX8uoN4BOvIVxgZGitJzE5iGvSOaEhGHYSm0Em7ihh6_s4nQsXv1d6hPflaFQR3NpIqEscbIHVtIHbIx82LprES2smlDo May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Domain-Id: None May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Domain-Name: None May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Identity-Status: Confirmed May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Is-Admin-Project: True May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Openstack-Nova-Api-Version: 2.90 May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Domain-Id: default May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Domain-Name: Default May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Name: admin May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Role: reader,admin,member May 17 15:35:23.212495 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Roles: reader,admin,member May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_519a641cdee343408fe589d891a54066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/519a641cdee343408fe589d891a54066"}]}] May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant: admin May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant-Name: admin May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User: admin May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Domain-Id: default May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Domain-Name: Default May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Id: 2ee5e213008a431f98430b648aa9d659 May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Name: admin May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: method: > May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: exception: Flavor 42 could not be found. May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: action_args: {'id': '42'} May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:35:23.214066 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:23.214993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:23.216277 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-3291c5f3-bd88-4532-abe8-13c569a38baa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:35:23.217532 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-3291c5f3-bd88-4532-abe8-13c569a38baa admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013460 May 17 15:35:23.217532 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Tue May 17 15:35:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 15:35:24.090331 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-8ec2575f-a78f-465e-a849-2fb8265c93ab admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:24.091346 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-8ec2575f-a78f-465e-a849-2fb8265c93ab admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 17 15:35:24.091765 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:24.281572 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-ddf51203-0f9f-4402-b72d-832313cc6d3f admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:24.286855 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.wsgi [None req-ddf51203-0f9f-4402-b72d-832313cc6d3f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-ddf51203-0f9f-4402-b72d-832313cc6d3f admin admin] Request method failure captured: May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Accept: application/json May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Accept-Encoding: gzip, deflate May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Connection: keep-alive May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Content-Length: 0 May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Host: 10.222.0.75 May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Openstack-Api-Version: compute 2.90 May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Openstack-System-Scope: None May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: User-Agent: python-novaclient May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Auth-Token: gAAAAABig8C8cr0q4uGHsQr2LC73YBWSnq-BdcWSQ-FDSV0wQKZQQNU9NPsAo6uVCb0L3vJVUM8ZjNh4wOr4vnTqDIXUcI22qkTOgOwJ82hmgzR4ERBoOt_wAfY0DKXdLrDb0TsBnhU-fNUVoJknCqjovXfmhwS7FSGBVQxGMeG_0WBNY4GaSoM May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Domain-Id: None May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Domain-Name: None May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Identity-Status: Confirmed May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Is-Admin-Project: True May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Openstack-Nova-Api-Version: 2.90 May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Domain-Id: default May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Domain-Name: Default May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Name: admin May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Role: reader,admin,member May 17 15:35:24.288341 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Roles: reader,admin,member May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_519a641cdee343408fe589d891a54066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/519a641cdee343408fe589d891a54066"}]}] May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant: admin May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant-Name: admin May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User: admin May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Domain-Id: default May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Domain-Name: Default May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Id: 2ee5e213008a431f98430b648aa9d659 May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Name: admin May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: method: > May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: exception: Flavor 84 could not be found. May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: action_args: {'id': '84'} May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:35:24.289801 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:24.290647 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:24.292175 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-ddf51203-0f9f-4402-b72d-832313cc6d3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:35:24.293451 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-ddf51203-0f9f-4402-b72d-832313cc6d3f admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059540 May 17 15:35:24.293451 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Tue May 17 15:35:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 15:35:24.299503 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-7ceef58f-92da-4ab9-a31b-3c35ee5ea1d8 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:24.312827 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-7ceef58f-92da-4ab9-a31b-3c35ee5ea1d8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016912 May 17 15:35:24.313296 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Tue May 17 15:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:24.322727 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-e5100ab5-8950-44c6-9928-875066fae73d admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:24.336671 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-e5100ab5-8950-44c6-9928-875066fae73d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017401 May 17 15:35:24.337192 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Tue May 17 15:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:24.346467 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1264c21e-d08c-4605-b1ca-5759175901a8 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:24.351511 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.wsgi [None req-1264c21e-d08c-4605-b1ca-5759175901a8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1264c21e-d08c-4605-b1ca-5759175901a8 admin admin] Request method failure captured: May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Accept: application/json May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Accept-Encoding: gzip, deflate May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Connection: keep-alive May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Content-Length: 0 May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Host: 10.222.0.75 May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Openstack-Api-Version: compute 2.90 May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Openstack-System-Scope: None May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: User-Agent: python-novaclient May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Auth-Token: gAAAAABig8C8cr0q4uGHsQr2LC73YBWSnq-BdcWSQ-FDSV0wQKZQQNU9NPsAo6uVCb0L3vJVUM8ZjNh4wOr4vnTqDIXUcI22qkTOgOwJ82hmgzR4ERBoOt_wAfY0DKXdLrDb0TsBnhU-fNUVoJknCqjovXfmhwS7FSGBVQxGMeG_0WBNY4GaSoM May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Domain-Id: None May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Domain-Name: None May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Identity-Status: Confirmed May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Is-Admin-Project: True May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Openstack-Nova-Api-Version: 2.90 May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Domain-Id: default May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Domain-Name: Default May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Name: admin May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Role: reader,admin,member May 17 15:35:24.352990 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Roles: reader,admin,member May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_519a641cdee343408fe589d891a54066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/519a641cdee343408fe589d891a54066"}]}] May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant: admin May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant-Name: admin May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User: admin May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Domain-Id: default May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Domain-Name: Default May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Id: 2ee5e213008a431f98430b648aa9d659 May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Name: admin May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: method: > May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: exception: Flavor 84 could not be found. May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: action_args: {'id': '84'} May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:35:24.354532 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:24.355502 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:24.356799 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-1264c21e-d08c-4605-b1ca-5759175901a8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:35:24.358063 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-1264c21e-d08c-4605-b1ca-5759175901a8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011619 May 17 15:35:24.358063 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Tue May 17 15:35:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 15:35:25.227167 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-e5100ab5-8950-44c6-9928-875066fae73d admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:25.228165 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-e5100ab5-8950-44c6-9928-875066fae73d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 17 15:35:25.228553 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:25.411875 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-4a46f3fb-ec94-4cca-aeaf-23109dd9d41d admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:25.417588 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.wsgi [None req-4a46f3fb-ec94-4cca-aeaf-23109dd9d41d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-4a46f3fb-ec94-4cca-aeaf-23109dd9d41d admin admin] Request method failure captured: May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Accept: application/json May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Accept-Encoding: gzip, deflate May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Connection: keep-alive May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Content-Length: 0 May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Host: 10.222.0.75 May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Openstack-Api-Version: compute 2.90 May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Openstack-System-Scope: None May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: User-Agent: python-novaclient May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Auth-Token: gAAAAABig8C9hC5YTAkiHzAU3zwGSVyQP1FB0Ax532TZhGdXfG7E32d6nMSW9e8Y4dEUj_uGll5Vs4HrwhQ3KPbfusdkyTRs5sqswUDKiRhiaGlckFVsH-rmZ-ejF7oqnLUNb4RPdzKQ8YLeDr_htT_Zsf8cGWHQCNyVD_s48wbcVrFbYm6GbWk May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Domain-Id: None May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Domain-Name: None May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Identity-Status: Confirmed May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Is-Admin-Project: True May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Openstack-Nova-Api-Version: 2.90 May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Domain-Id: default May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Domain-Name: Default May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Project-Name: admin May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Role: reader,admin,member May 17 15:35:25.419120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Roles: reader,admin,member May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_519a641cdee343408fe589d891a54066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/519a641cdee343408fe589d891a54066"}]}] May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant: admin May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-Tenant-Name: admin May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User: admin May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Domain-Id: default May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Domain-Name: Default May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Id: 2ee5e213008a431f98430b648aa9d659 May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: X-User-Name: admin May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: method: > May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: exception: Flavor 451 could not be found. May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: action_args: {'id': '451'} May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:35:25.420619 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:25.421575 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: ERROR nova.api.openstack.wsgi May 17 15:35:25.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-4a46f3fb-ec94-4cca-aeaf-23109dd9d41d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109559) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:35:25.423832 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-4a46f3fb-ec94-4cca-aeaf-23109dd9d41d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058864 May 17 15:35:25.423832 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Tue May 17 15:35:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 15:35:25.430250 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-e88f5eaf-ba89-4930-9e7c-4db53a72a726 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:25.443474 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-e88f5eaf-ba89-4930-9e7c-4db53a72a726 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016799 May 17 15:35:25.444000 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Tue May 17 15:35:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:25.453120 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:25.466992 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017332 May 17 15:35:25.467536 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Tue May 17 15:35:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:35:25.477224 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-f3639869-95f2-44c1-8018-7dd22bbbdff9 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:25.482514 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.wsgi [None req-f3639869-95f2-44c1-8018-7dd22bbbdff9 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-f3639869-95f2-44c1-8018-7dd22bbbdff9 admin admin] Request method failure captured: May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Accept: application/json May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Accept-Encoding: gzip, deflate May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Connection: keep-alive May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Content-Length: 0 May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Host: 10.222.0.75 May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Openstack-Api-Version: compute 2.90 May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Openstack-System-Scope: None May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: User-Agent: python-novaclient May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Auth-Token: gAAAAABig8C9hC5YTAkiHzAU3zwGSVyQP1FB0Ax532TZhGdXfG7E32d6nMSW9e8Y4dEUj_uGll5Vs4HrwhQ3KPbfusdkyTRs5sqswUDKiRhiaGlckFVsH-rmZ-ejF7oqnLUNb4RPdzKQ8YLeDr_htT_Zsf8cGWHQCNyVD_s48wbcVrFbYm6GbWk May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Domain-Id: None May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Domain-Name: None May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Identity-Status: Confirmed May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Is-Admin-Project: True May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Openstack-Nova-Api-Version: 2.90 May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Domain-Id: default May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Domain-Name: Default May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Project-Name: admin May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Role: reader,admin,member May 17 15:35:25.484047 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Roles: reader,admin,member May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_519a641cdee343408fe589d891a54066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/519a641cdee343408fe589d891a54066"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/519a641cdee343408fe589d891a54066"}]}] May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant: admin May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant-Id: 519a641cdee343408fe589d891a54066 May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-Tenant-Name: admin May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User: admin May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Domain-Id: default May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Domain-Name: Default May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Id: 2ee5e213008a431f98430b648aa9d659 May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: X-User-Name: admin May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: method: > May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: exception: Flavor 451 could not be found. May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: action_args: {'id': '451'} May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:35:25.485580 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:25.486792 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: ERROR nova.api.openstack.wsgi May 17 15:35:25.487965 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-f3639869-95f2-44c1-8018-7dd22bbbdff9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:35:25.488959 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-f3639869-95f2-44c1-8018-7dd22bbbdff9 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011736 May 17 15:35:25.488959 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Tue May 17 15:35:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 15:35:26.361190 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:26.362254 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 May 17 15:35:26.362659 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:26.549294 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-5fb71c55-ff03-4fce-aebb-c1273c79f9ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:35:26.566785 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-5fb71c55-ff03-4fce-aebb-c1273c79f9ba admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067728 May 17 15:35:26.567316 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Tue May 17 15:35:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:35:27.460993 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:27.462016 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 17 15:35:27.462407 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:27.646343 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-f4131dad-d47a-4cb2-b704-06df83642955 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:35:27.664611 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-f4131dad-d47a-4cb2-b704-06df83642955 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068547 May 17 15:35:27.665147 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Tue May 17 15:35:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:35:28.549760 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:28.550806 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 17 15:35:28.551208 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:35:28.734993 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-fafd4238-82cd-49eb-800f-d823caa7a7f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:35:28.752070 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-fafd4238-82cd-49eb-800f-d823caa7a7f8 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.066737 May 17 15:35:28.752605 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Tue May 17 15:35:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:35:29.640341 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:29.641361 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 17 15:35:29.642417 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:29.838980 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-f2244c1a-37ac-42dd-8b18-6da00eac6369 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:35:29.857130 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-f2244c1a-37ac-42dd-8b18-6da00eac6369 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080434 May 17 15:35:29.857675 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Tue May 17 15:35:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:35:30.731937 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:30.732940 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 17 15:35:30.733333 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:35:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:35:30.927015 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-ea6a85d1-5e50-4001-bc34-b1a33af71849 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:35:30.946256 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-ea6a85d1-5e50-4001-bc34-b1a33af71849 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076068 May 17 15:35:30.946731 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Tue May 17 15:35:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:36:32.645418 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:36:32.646473 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-6aa22944-22bd-4374-8d96-bb6cab24c5b5 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 17 15:36:32.646897 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 930 bytes} [Tue May 17 15:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:36:32.705370 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-12e747a3-833d-49ab-b212-1cbff115fbda admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:36:32.724261 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-12e747a3-833d-49ab-b212-1cbff115fbda admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071478 May 17 15:36:32.724798 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1291 bytes} [Tue May 17 15:36:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:36:32.747695 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-734f101a-fe23-4ccc-8276-7eb5ee62506d admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:36:32.755886 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-734f101a-fe23-4ccc-8276-7eb5ee62506d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012371 May 17 15:36:32.756407 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1282 bytes} [Tue May 17 15:36:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:36:32.767491 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-9e13d270-e258-4059-90be-11e4991b9ec4 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:36:32.774859 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-9e13d270-e258-4059-90be-11e4991b9ec4 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010902 May 17 15:36:32.775372 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1285 bytes} [Tue May 17 15:36:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:36:32.786168 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:36:32.793457 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010740 May 17 15:36:32.793969 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1285 bytes} [Tue May 17 15:36:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:36:32.805004 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-27e468ef-f008-434e-9aec-479649fab2cb admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:36:32.812266 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-27e468ef-f008-434e-9aec-479649fab2cb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010680 May 17 15:36:32.812779 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1282 bytes} [Tue May 17 15:36:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:39:52.155626 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:39:52.156650 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 17 15:39:52.157053 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:39:52.426719 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-35d75880-9825-4c51-b8bd-df47d3a3ebbb admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:39:52.427881 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:39:52.427881 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: warnings.warn(msg) May 17 15:39:52.429062 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-35d75880-9825-4c51-b8bd-df47d3a3ebbb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:39:52.429523 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-35d75880-9825-4c51-b8bd-df47d3a3ebbb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:39:52.430320 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-35d75880-9825-4c51-b8bd-df47d3a3ebbb admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:39:52.430743 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-35d75880-9825-4c51-b8bd-df47d3a3ebbb admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:39:52.463105 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-35d75880-9825-4c51-b8bd-df47d3a3ebbb admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.145820 May 17 15:39:52.463648 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Tue May 17 15:39:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:39:53.377757 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:39:53.378805 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 17 15:39:53.379207 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:39:53.567021 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-75277d96-4259-4a0a-b6d8-fff22f6f0fbf admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:39:53.568192 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:39:53.568192 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: warnings.warn(msg) May 17 15:39:53.569374 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-75277d96-4259-4a0a-b6d8-fff22f6f0fbf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:39:53.569819 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-75277d96-4259-4a0a-b6d8-fff22f6f0fbf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:39:53.570632 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-75277d96-4259-4a0a-b6d8-fff22f6f0fbf admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:39:53.571056 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-75277d96-4259-4a0a-b6d8-fff22f6f0fbf admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:39:53.589869 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-75277d96-4259-4a0a-b6d8-fff22f6f0fbf admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.073978 May 17 15:39:53.590461 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Tue May 17 15:39:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:40:04.896005 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:40:04.897020 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 17 15:40:04.897417 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:40:05.085893 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-3d26019b-1824-4b8b-ae00-4f7d5e12e9a1 admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:40:05.087110 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:40:05.087110 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: warnings.warn(msg) May 17 15:40:05.088297 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-3d26019b-1824-4b8b-ae00-4f7d5e12e9a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:40:05.088771 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-3d26019b-1824-4b8b-ae00-4f7d5e12e9a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:40:05.089570 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-3d26019b-1824-4b8b-ae00-4f7d5e12e9a1 admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:40:05.090025 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-3d26019b-1824-4b8b-ae00-4f7d5e12e9a1 admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:40:05.114494 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-3d26019b-1824-4b8b-ae00-4f7d5e12e9a1 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079235 May 17 15:40:05.114969 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Tue May 17 15:40:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:40:06.004272 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: DEBUG nova.api.openstack.wsgi [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] Calling method '>' {{(pid=109559) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:40:06.005311 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: INFO nova.api.openstack.requestlog [None req-f5b75e19-a0a7-4edb-8bc2-4d80fd4da218 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 17 15:40:06.005713 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: [pid: 109559|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Tue May 17 15:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:40:06.192136 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG nova.api.openstack.wsgi [None req-a43ceab4-5673-4645-8dd9-a611de995dda admin admin] Calling method '>' {{(pid=109558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:40:06.193301 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 15:40:06.193301 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: warnings.warn(msg) May 17 15:40:06.194504 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-a43ceab4-5673-4645-8dd9-a611de995dda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:40:06.194944 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-a43ceab4-5673-4645-8dd9-a611de995dda admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:40:06.195740 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-a43ceab4-5673-4645-8dd9-a611de995dda admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:40:06.196169 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: DEBUG oslo_concurrency.lockutils [None req-a43ceab4-5673-4645-8dd9-a611de995dda admin admin] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:40:06.218721 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: INFO nova.api.openstack.requestlog [None req-a43ceab4-5673-4645-8dd9-a611de995dda admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076480 May 17 15:40:06.219450 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: [pid: 109558|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Tue May 17 15:40:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:41:02.713693 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: Tue May 17 15:41:02 2022 - graceful shutdown triggered... May 17 15:41:02.714250 dv-cinder-842128-1-iscsi devstack@n-api.service[109558]: Gracefully killing worker 1 (pid: 109558)... May 17 15:41:02.713796 dv-cinder-842128-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 15:41:02.715617 dv-cinder-842128-1-iscsi devstack@n-api.service[109559]: Gracefully killing worker 2 (pid: 109559)... May 17 15:41:03.714904 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: worker 1 buried after 1 seconds May 17 15:41:03.714904 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: worker 2 buried after 1 seconds May 17 15:41:03.714904 dv-cinder-842128-1-iscsi devstack@n-api.service[109557]: goodbye to uWSGI. May 17 15:41:03.716330 dv-cinder-842128-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 15:41:03.716897 dv-cinder-842128-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 15:41:03.719621 dv-cinder-842128-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 15:41:03.736162 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 15:41:03 2022] *** May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: nodename: dv-cinder-842128-1-iscsi May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: machine: x86_64 May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: clock source: unix May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: pcre jit disabled May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: detected number of CPU cores: 4 May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: current working directory: / May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: detected binary path: /usr/bin/uwsgi-core May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: your processes number limit is 47680 May 17 15:41:03.761748 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: your memory page size is 4096 bytes May 17 15:41:03.762762 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: detected max file descriptor number: 2048 May 17 15:41:03.762762 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: lock engine: pthread robust mutexes May 17 15:41:03.762762 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: thunder lock: enabled May 17 15:41:03.762762 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 15:41:03.762762 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 15:41:03.810640 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: Python main interpreter initialized at 0x5604257be9c0 May 17 15:41:03.810640 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: python threads support enabled May 17 15:41:03.810640 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: your server socket listen backlog is limited to 100 connections May 17 15:41:03.810640 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: your mercy for graceful operations on workers is 90 seconds May 17 15:41:03.811090 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: mapped 403077 bytes (393 KB) for 2 cores May 17 15:41:03.811090 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: *** Operational MODE: preforking *** May 17 15:41:03.811354 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: *** uWSGI is running in multiple interpreter mode *** May 17 15:41:03.811354 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: spawned uWSGI master process (pid: 123884) May 17 15:41:03.811561 dv-cinder-842128-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 15:41:03.830081 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: spawned uWSGI worker 1 (pid: 123908, cores: 1) May 17 15:41:03.830081 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: spawned uWSGI worker 2 (pid: 123909, cores: 1) May 17 15:41:03.830081 dv-cinder-842128-1-iscsi devstack@n-api.service[123884]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 15:41:05.030337 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 15:41:05.036667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 15:41:05.832047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:41:05.832047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: from cryptography.utils import int_from_bytes May 17 15:41:05.832391 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:41:05.832391 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: from cryptography.utils import int_from_bytes May 17 15:41:05.838612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:41:05.838612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: from cryptography.utils import int_from_bytes May 17 15:41:05.838938 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 15:41:05.838938 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: from cryptography.utils import int_from_bytes May 17 15:41:08.274623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 15:41:08.275224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 15:41:08.275319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 15:41:08.275703 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 15:41:08.275952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 15:41:08.276351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.276682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.277590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.277920 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.278283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.278605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.278937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.279269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.279606 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.279875 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.280199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.280531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842128-1-iscsi {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.280698 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 15:41:08.281066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.281149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 15:41:08.281222 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.281473 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.281579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 15:41:08.281799 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.281901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 15:41:08.282143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 15:41:08.282251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.282456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.282559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.282774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.282879 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.283128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.283291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.284698 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.284829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.284908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.284989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285062 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285132 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285353 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285429 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285916 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842128-1-iscsi {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.285992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.286539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.286778 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.286985 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.287200 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.287418 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.287634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842128-1-iscsi {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.287851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.288091 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.288304 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.288506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.288708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.288927 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.289129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.289332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.289541 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.289787 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.289987 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.290241 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.292922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.293195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.293427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.293636 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.293842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.294044 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.294233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.294386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.294575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.294728 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.294884 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.295027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.295178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.295396 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.295553 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.295706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.295860 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296002 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296002 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296282 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842128-1-iscsi {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296423 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296590 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.296885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.297805 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.297969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.298156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.298317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.298460 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.298603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.298751 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.298900 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.299050 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.299200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.299363 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.301173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.301956 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.302212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.302371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.302371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.302660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.302804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.302957 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.303110 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.303272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.303415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.303584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.303742 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.303973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.304125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.304274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.304415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.304555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.304707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.305206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.305360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.305511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.307297 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.307512 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.307512 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.307866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308020 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308170 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308318 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308770 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.308918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309804 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.309945 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.310127 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.310291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.310435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.310583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.310724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.310874 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.311031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.311188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.311337 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.311485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.311705 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.313099 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.313459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.313609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.313758 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.313910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.314126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.314285 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.314430 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.314578 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.314734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.314877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315038 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315194 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315347 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.315933 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.316752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.316907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317050 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317512 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317816 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.317971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.318159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.318301 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.319340 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.319809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.319956 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320821 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.320961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321267 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321267 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321837 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.321837 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.322526 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.322672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.322814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.322914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.323212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.323362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.323492 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.323618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.324239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.324374 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.324511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.324647 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.324788 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.324914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325571 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.325978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.326186 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.326380 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.326518 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.326661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.326789 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.326917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327705 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.327974 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328846 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.328994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.329921 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330062 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.330894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331298 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331690 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331829 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.331956 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.332103 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.332572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.332708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.332835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.332974 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.333101 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.333414 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.333544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.333678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.333814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.333942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.334084 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.334214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.334351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.334486 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.334625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.334760 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.334887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.335003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.335127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.335261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.335404 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.335404 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.335650 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.335784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.335784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.336107 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.336242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.336242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.336587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.336723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.336723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.336974 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.337115 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.337115 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.337369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.337495 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.337495 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.337751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.337883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.338043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 15:41:08.338173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.338173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.338424 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.338563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.338563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.338908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.339042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.339042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.339307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.339973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.339973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340242 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340502 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.340998 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341123 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341123 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341499 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341499 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.341880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.342099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.342587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.342735 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.342870 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.342870 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.343125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.343252 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.343252 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.343710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.343846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.343979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.344835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.345927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346662 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346801 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.346937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.347947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348458 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348728 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.348728 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.349828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.350444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.351664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.351791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.351791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.352030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.352169 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.352169 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.352792 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.352932 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.352932 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.353183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.353717 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.353717 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.353993 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354534 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354534 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354534 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.354890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355062 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355062 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.355964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.356097 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.356097 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.356517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.356864 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.356864 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.356864 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.357950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358092 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358092 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358491 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358491 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358745 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.358879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.359407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.359532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.359532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.359532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.359895 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.359895 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.360139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.360264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.360574 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.360714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.360841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.361113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.361247 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.361442 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.361635 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.361764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.362089 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.362236 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.362412 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.363110 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.363251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.363386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.363386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.363653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.364004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.364144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.364272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.364481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.364627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.364896 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.365218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.365369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.365636 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.365879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.366037 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.366238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.366560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.366840 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.366977 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.367196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.367470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.367608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.367818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.368133 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.368268 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.368446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.368764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.368901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.369087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.369406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.369610 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.369748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.370040 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.370361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.370489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.370706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.371019 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.371159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.371333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.371650 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.371853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.371984 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.372283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.372743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.372890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.373230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.373230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.373481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.373622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.373855 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.374206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.374339 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.374493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.374804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.374969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.375106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.375447 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.375761 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.375898 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.376063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.376387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.376515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.376714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.377035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.377178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.377352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378186 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378464 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378464 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378711 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378845 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.378978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.379214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.379413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.379544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.379830 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.380145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.380433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.380570 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.380772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.381088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.381216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.381403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.381712 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.381920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.382130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.382363 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.382677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.382971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.383341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.383491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.383621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.383923 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.384315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.384465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.384603 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.384841 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.384972 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.385206 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.385560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.385691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.385875 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.386736 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.386873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.387149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.387352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.387619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.387752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.387972 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.388286 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.388527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.388670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.388901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.389214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.389342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.389525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.389837 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.389980 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.390173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.390495 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.390725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.390865 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.391112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.391434 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.391579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.392048 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.392614 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.392795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.393132 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.393246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.393459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.393776 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.393868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.394122 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.394651 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.394762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.394762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.395130 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.395247 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.395448 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.395627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.395800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.396118 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.396217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.396436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.396644 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.396769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.397172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.397275 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.397398 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.397561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.397712 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.397880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.398048 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.398236 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.398367 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.398604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.398707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.398932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.399024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.399287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.399384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.399605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.399770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.399921 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.400013 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.400231 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.400355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.400547 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.400687 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.400863 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.401052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.401185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.401377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.401502 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.401865 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.402525 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.402706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.403029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.403150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.403346 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.403538 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.403666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.403982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.404084 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.404293 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.404530 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.404622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.404914 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.405043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.405228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.405541 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.405638 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.405853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.406095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.406216 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.406503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.406606 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.406835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.407155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.407262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.407471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.407682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.407795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.408084 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.408175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.408396 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.408708 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.408806 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.409024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.409303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.409395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.409661 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.409751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.409974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.410126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.410312 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.410404 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.410624 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.410726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.410936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.411035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.411246 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.411377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.411560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.411723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.411868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.412051 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.412177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.412386 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.412477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.412713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.412817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.413047 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.413198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.413390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.413509 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.413751 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.413906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.414109 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.414322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.414415 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.414634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.414930 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.415030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.415282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.415748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.415834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.415907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.415988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.416942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417046 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.417907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.418197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.418430 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.418559 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.418777 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.418930 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.419090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.419400 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.419518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.419725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.419915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.420043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.420362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.420465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.420688 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.420979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.421069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.421318 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.421419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.421634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.421725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.421951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.422068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.422297 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.422430 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.422617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.422791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.422954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.423133 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.423231 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.423465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.423576 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.423913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424118 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424750 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.424889 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.425070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.425176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.425384 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.425696 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.425812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.426031 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.426238 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.426349 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.426658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.426755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.426968 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.427198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.427296 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.427581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.427713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.427900 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.428212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.428310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.428655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.428795 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.428975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.429167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.429295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.429603 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.429709 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.429922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.430196 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.430291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.430586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.430689 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.430907 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.431161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.431259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.431628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.431719 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.431946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.432236 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.432343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.432570 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.432667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.432879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.432983 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.433227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.433328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.433579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.433684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.433881 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.433988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.434218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.434312 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.434532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.434668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.434843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.434994 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.435172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.435320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.435482 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.435644 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.435824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.436073 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.436232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.436502 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.436592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.436847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.436994 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.437268 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.437491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.437589 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.437885 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.438021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.438311 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.438487 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.438638 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.438967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.439058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.439278 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.439468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.439596 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.439912 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.440243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.440363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.440573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.440890 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.440980 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.441212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.441393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.441523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.441853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.441952 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.442207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.442427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.442510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.442840 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.442967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.443261 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.443538 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.443651 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.443962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.444068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.444227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.444558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.444655 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.444868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.445030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.445178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.445372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.445493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.445702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.445792 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.446047 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.446165 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.446383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.446497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.446707 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.446820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447028 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.447965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.448070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.448276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.448381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.448592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.449214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.449457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.449814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.450160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.450493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.450820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.451056 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.451154 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.451395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.451501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.451717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.451815 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.452992 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.453096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.453311 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.453409 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.453630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.453758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.453952 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.454107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.454308 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.454420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.454622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.454727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.454962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.455050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.455299 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.455396 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.455618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.455717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.455944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456042 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.456988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.457198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.457295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.457507 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.457612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.457817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.457922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.458153 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.458272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.458469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.458573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.458768 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.458867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.459078 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.459185 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.459389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.459494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.459702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.459792 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460013 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460329 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460745 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.460954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461353 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461878 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.461986 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.462220 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.462312 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.462540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.462632 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.462854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.462946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.463174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.463264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.463488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.463577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.463813 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.463924 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.464126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.464228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465011 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465343 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465458 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465651 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.465972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.466157 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.466309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.466404 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.466638 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.466728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.466964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467060 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467679 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467897 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.467999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.468208 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.468298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.468526 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.468773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.468880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.469111 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.469217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.469435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.469533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.469754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.469868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.470130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.470250 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.470426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.470518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.470746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.470838 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.471063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.471163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.471381 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.471473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.471697 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.471798 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472103 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472318 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472423 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.472943 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.473043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.473275 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.473380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.473592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.473685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.473904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474014 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474557 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474656 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.474999 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.475230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.475339 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.475531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.475628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.475852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.476857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.476973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.476973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.477107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.477352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.477588 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.477685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.478388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.478489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.478564 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480294 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480294 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480495 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480495 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480898 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.480995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481081 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481338 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481338 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481496 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.481851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482031 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482119 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.482821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.483069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.483161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.483388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.483486 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.483712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.483804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484037 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484129 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484456 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.484983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.485075 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.485300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.485399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.485611 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.485711 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.485931 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.486062 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.486275 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.486381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.486589 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.486690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.486906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.487004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.487220 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.487324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.487540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.487759 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.487851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.488114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.488205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.488437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.488529 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.488849 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.488960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.489093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.489200 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.489410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.489504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.489720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.489809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.490052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.490164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.490371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.490503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.490686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.490828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491636 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.491948 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.492114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.492263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.492440 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.492578 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.492764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.492887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.493083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.493202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.493543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.493651 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.493838 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.493940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.494171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.494263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.494485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.494589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.494794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.494899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.495107 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.495204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.495419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.495550 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.495751 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.495844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.496063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.496152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.496373 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.496472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.496690 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.496795 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497001 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497630 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497729 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.497949 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.498216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.498322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.498544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.498645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.498862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.498968 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.499256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.499346 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.499568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.499697 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.499881 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.499972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.500203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.500286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.500519 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.500614 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.500847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501473 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.501876 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.502148 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.502254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.502484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.502689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.502788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.503032 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.503131 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.503359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.503459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.503705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.503794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504679 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.504991 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.505083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.505321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.505440 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.505641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.505744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506164 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506296 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.506938 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507040 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507879 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.507978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.508191 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.508288 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.508509 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.508599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.508825 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.508930 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.509140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.509238 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.509454 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.509550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.509769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.509868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.510104 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.510200 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.510437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.510541 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.510750 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.510853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.511083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.511702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.511938 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512038 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512261 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.512977 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.513209 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.513306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.513524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.513623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.513839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.513931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.514178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.514283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.514494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.514631 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.514848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515032 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.515950 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.516152 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.516250 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.516469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.516566 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.516784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.516929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.517111 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.517211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.517428 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.517527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.517764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.517895 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.518124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.518232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.518441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.518545 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.518755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.518848 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.519073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.519164 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.519384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.519481 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.519694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.519791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520099 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520632 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.520940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521875 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.521973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.522209 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.522316 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.522521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.522613 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.522833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.522932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.523145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.523247 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.523453 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.523543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.523763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.523861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.524079 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.524183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.524389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.524488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.524742 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.524862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525118 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525325 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525416 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.525943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.526100 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.526277 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.526369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.526587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.526677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.526967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.527066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.527306 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.527408 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.527647 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.527745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.527965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.528063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.528287 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.528884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.529111 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.529203 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.529440 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.529559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.529776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.529895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.530113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.530237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.530442 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.530672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.530771 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531013 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531338 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531432 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.531985 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.532092 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.532299 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.532399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.532618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.532718 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.532933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533034 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533340 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.533992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.534227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.534325 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.534559 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.534652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.534883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.534987 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.535208 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.535302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.535530 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.535621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.535848 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.535991 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.536169 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.536259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.536492 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.536581 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.536808 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.536901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.537130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.537251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.537446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.537576 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.537763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.537902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.538108 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.538255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.538430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.538580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.538763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.538902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.539095 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.539224 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.539416 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.539544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.539748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.539859 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.540080 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.540179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.540434 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.540539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.540756 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.540848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.541078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.541177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.541411 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.541511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.541734 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.541824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.542074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.542181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.542506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.542611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.542705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 15:41:08.542791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.543109 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.543645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.543973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.544315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.544677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.545014 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.545340 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.545666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.546031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.546339 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.546653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.546972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.547291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.547606 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.547941 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.548262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.548578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.548905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.549222 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.549770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.550162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.550492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.550829 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.551167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.551497 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.551817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.552151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.552468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.552785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.553110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.553431 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.553744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.554080 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.554402 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.554721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.555033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.555355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.555665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.555999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.556313 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.556628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.556941 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.557260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.557575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.557893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.558281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.558598 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.558919 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.559237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.559620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.559871 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.560192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.560512 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.561429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.561429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.561617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.561820 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.562156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.562487 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.562805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.563138 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.563467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.563786 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.564144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.565194 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.565194 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.565582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.565719 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.566116 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.566406 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.566726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.567045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.567365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.567708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.568063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.568383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.568703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.569024 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.569289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.569388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.569663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.569971 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.570314 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.570635 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.570954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.571275 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.571595 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.571919 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.572427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.572605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.572939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.573270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.573598 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.574476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.574800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.575122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.575442 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.575771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.576109 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.576435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.576754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.577195 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.577521 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.577851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.578215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.578537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.578867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.579200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.579524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.579856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.580179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.580518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.580869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.581207 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.581543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.581860 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.582201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.582518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.582839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.583171 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.583489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.583803 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.584119 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.584437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.584751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.585066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.585379 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.585690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.586024 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.586342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.586654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.586972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.587286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.587597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.587908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.588235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.588548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.588859 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.589171 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.590061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.590374 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.590716 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.591060 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.591386 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.591720 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.592043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.592375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.592694 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.593024 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.593357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.593682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.594034 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.594361 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.594681 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.595002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.595324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.595644 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.595961 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.596277 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.596610 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.596943 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.597258 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.597592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.597919 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.598278 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.598604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.598926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.599265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.599587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.599907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.600234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.600554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.600875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.601467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.601790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.602151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.602486 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.602805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.603138 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.603473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.603827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.604149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.604499 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.604836 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.605187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.605508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.605826 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 15:41:08.606108 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 15:41:08.630022 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_db.sqlalchemy.engines [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.635347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.context [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91629321-da27-4ee4-9a78-15344e4578f9(cell1) {{(pid=123909) load_cells /opt/stack/nova/nova/context.py:464}} May 17 15:41:08.640337 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:41:08.641925 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:41:08.642776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:41:08.644731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:41:08.656073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.657984 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.695039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.context [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),91629321-da27-4ee4-9a78-15344e4578f9(cell1) {{(pid=123908) load_cells /opt/stack/nova/nova/context.py:464}} May 17 15:41:08.700029 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:41:08.701629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:41:08.702459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:41:08.704392 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:41:08.715323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_db.sqlalchemy.engines [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.716712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_db.sqlalchemy.engines [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.819944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_db.sqlalchemy.engines [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:08.885470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_db.sqlalchemy.engines [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 15:41:09.143488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: WARNING keystonemiddleware.auth_token [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:41:09.152184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: WARNING keystonemiddleware.auth_token [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:41:09.227861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: WARNING keystonemiddleware.auth_token [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:41:09.236611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: WARNING keystonemiddleware.auth_token [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:41:09.500584 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: WARNING keystonemiddleware.auth_token [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:41:09.506884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: WARNING keystonemiddleware.auth_token [None req-e4c1bed0-c01b-4fe9-b546-e50155283e97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:41:09.512176 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604257be9c0 pid: 123909 (default app) May 17 15:41:09.588287 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: WARNING keystonemiddleware.auth_token [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 15:41:09.595123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: WARNING keystonemiddleware.auth_token [None req-0300589f-de12-4eda-a7dc-b3afca73203c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 15:41:09.600609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604257be9c0 pid: 123908 (default app) May 17 15:41:52.546124 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-362b0d2b-cab6-4433-8b57-a9354ef488b6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Action: 'create', calling method: .version_select at 0x7f83fd411280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-480430055", "metadata": {"Type": "work"}}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:41:55.520107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-362b0d2b-cab6-4433-8b57-a9354ef488b6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.578836 May 17 15:41:55.521573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1155 bytes} [Tue May 17 15:41:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4583 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 15:41:55.535325 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-53f73333-f389-4f44-ad6a-00b428759340 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Calling method '.version_select at 0x7f83fd26a280>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:41:55.632435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1793769360", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "networks": [{"uuid": "81bb7a4a-20a5-4b4f-b774-df99f2c59572"}]}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:41:55.698950 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-53f73333-f389-4f44-ad6a-00b428759340 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800" status: 200 len: 352 microversion: 2.1 time: 0.168522 May 17 15:41:55.699847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 2/2] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:41:55 2022] GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:41:56.712884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6dfd063d-0182-4e49-b1bd-0d35000d8aac tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Calling method '.version_select at 0x7f83fd26a4c0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:41:56.727063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] validate_networks() for [('81bb7a4a-20a5-4b4f-b774-df99f2c59572', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:41:56.866369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6dfd063d-0182-4e49-b1bd-0d35000d8aac tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800" status: 200 len: 353 microversion: 2.1 time: 0.156800 May 17 15:41:56.867557 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 3/3] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:41:56 2022] GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:41:56.878600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3e97e9f2-6180-4e5b-93c8-815c464daa55 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Calling method '.version_select at 0x7f83fd26a9d0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:41:56.988417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3e97e9f2-6180-4e5b-93c8-815c464daa55 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800" status: 200 len: 353 microversion: 2.1 time: 0.113335 May 17 15:41:57.003056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 4/4] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:41:56 2022] GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:41:57.012586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c1295bca-56d5-4595-a65d-ca6dc68615e2 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Calling method '.version_select at 0x7f83fd2740d0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:41:57.194112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c1295bca-56d5-4595-a65d-ca6dc68615e2 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800" status: 202 len: 0 microversion: 2.1 time: 0.188940 May 17 15:41:57.194644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 5/5] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:41:57 2022] DELETE /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:41:57.203212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2906ab4a-2de9-462e-ba1a-4bafcdfa9552 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Calling method '.version_select at 0x7f83fd26ad30>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:41:57.324972 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2906ab4a-2de9-462e-ba1a-4bafcdfa9552 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800" status: 200 len: 352 microversion: 2.1 time: 0.125447 May 17 15:41:57.325524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 6/6] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:41:57 2022] GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:41:58.338931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b719f8fa-9cbf-4988-84bb-dadfd7a2c6a6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Calling method '.version_select at 0x7f83fd26a0d0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:41:58.383875 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-b719f8fa-9cbf-4988-84bb-dadfd7a2c6a6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] HTTP exception thrown: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b719f8fa-9cbf-4988-84bb-dadfd7a2c6a6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Request method failure captured: May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 HTTP/1.1 May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8I-ClILtZ4DKqEQ18e0qXD18_X8G6RhitynNENRtx7PE7KCph7d03pp8TGNaQ6ktEt-p1hb6SiMoOrUdFKtTfYJJUXpvq76UUIoKBE_Fh1WHBdNqtmTq32PjnrAtxM_cj7FMB8S3fExeNg0NO-AMelTqV_QqVIPpu56UiClvG1rIyE May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 6921a8fdfe4d4c06b69a31392ae2dcbf May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesGetTestJSON-611985963 May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:41:58.389360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6921a8fdfe4d4c06b69a31392ae2dcbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_6921a8fdfe4d4c06b69a31392ae2dcbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6921a8fdfe4d4c06b69a31392ae2dcbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/6921a8fdfe4d4c06b69a31392ae2dcbf"}]}] May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesGetTestJSON-611985963 May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 6921a8fdfe4d4c06b69a31392ae2dcbf May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesGetTestJSON-611985963 May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesGetTestJSON-611985963-project May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: f765820a65e34d0b9d19a602f022b278 May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesGetTestJSON-611985963-project May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '35adb238-349b-4d7c-9acb-4869c47f8800'} May 17 15:41:58.390553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. (HTTP 404) (Request-ID: req-427d1726-8698-4be5-95d5-82a2cc26bb21) May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:41:58.391127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:41:58.392018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 15:41:58.392909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b719f8fa-9cbf-4988-84bb-dadfd7a2c6a6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] Returning 404 to user: Volume 35adb238-349b-4d7c-9acb-4869c47f8800 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:41:58.394869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b719f8fa-9cbf-4988-84bb-dadfd7a2c6a6 tempest-VolumesGetTestJSON-611985963 tempest-VolumesGetTestJSON-611985963-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800" status: 404 len: 109 microversion: 2.1 time: 0.057845 May 17 15:41:58.397671 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 7/7] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:41:58 2022] GET /compute/v2.1/os-volumes/35adb238-349b-4d7c-9acb-4869c47f8800 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:41:59.886123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:41:59.887852 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:41:59.889072 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:41:59.889653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:41:59.890588 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:41:59.912931 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:41:59.913599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:41:59.914621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:41:59.915201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:00.002090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Getting quotas for project 5e120255943e4fecadc7d4a2a9188f9d. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:00.024119 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Getting quotas for user df32bb55daa64c5396bd96a86f19b5d8 and project 5e120255943e4fecadc7d4a2a9188f9d. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:00.052710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:42:00.058934 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:42:00.269160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-eeacd3f3-8506-4233-afe3-d83989c0aaab tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.854110 May 17 15:42:00.281726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 1/8] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:41:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 5868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 15:42:00.286141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-402c21ff-3886-486f-853f-66bea82ec1dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:00.286906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-402c21ff-3886-486f-853f-66bea82ec1dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:00.648081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-402c21ff-3886-486f-853f-66bea82ec1dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:00.694263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-402c21ff-3886-486f-853f-66bea82ec1dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1215 microversion: 2.1 time: 0.412698 May 17 15:42:00.698360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 8/9] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:00 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1215 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:01.713104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c3b8f041-6f60-4875-82ae-e76e764a9662 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:01.714429 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c3b8f041-6f60-4875-82ae-e76e764a9662 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:01.796700 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a4a8d1a6-c957-4ced-b63a-ac1f7f15437e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'create', calling method: .version_select at 0x7f83fd217160>, body: {"keypair": {"name": "tempest-keypair-696945681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGYBrqiOqWWZHUQ23KWpls4ENa3IeLK5Zj+amhysOjKWh8gEXJ4PWNu3Be8eAfD/Ao+vPVUC8QZV5qg57tTA0GsmVAg3aQY3PKLcOoIx0ns91HhvH2N5GrU2u0FbndusQ=="}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:01.842596 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c3b8f041-6f60-4875-82ae-e76e764a9662 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:01.849602 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c3b8f041-6f60-4875-82ae-e76e764a9662 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1215 microversion: 2.1 time: 0.140791 May 17 15:42:01.865136 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 9/10] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:01 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:01.866330 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-a4a8d1a6-c957-4ced-b63a-ac1f7f15437e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for project bf36f753be81486182665056a949849c. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:01.872950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-a4a8d1a6-c957-4ced-b63a-ac1f7f15437e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for user 2e4972b781b043f69740342fde4efa73 and project bf36f753be81486182665056a949849c. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:01.972147 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a4a8d1a6-c957-4ced-b63a-ac1f7f15437e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.701360 May 17 15:42:01.972939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 2/11] 10.222.0.75 () {62 vars in 1199 bytes} [Tue May 17 15:42:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 703 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 15:42:02.867478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:02.868099 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:02.879211 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:02.879669 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:02.880477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:02.880906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:03.347735 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:03.386435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-33a50b6f-40a7-4855-b2e5-2a550acf2d04 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1211 microversion: 2.1 time: 0.521394 May 17 15:42:03.391792 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 10/12] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:02 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1211 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:04.417548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:04.420519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:04.473191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:04.474984 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:04.479281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:04.479924 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:05.058568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:05.084842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-51917625-f494-4775-8f06-f0d5a01d32d2 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1273 microversion: 2.1 time: 0.680218 May 17 15:42:05.089515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 3/13] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:04 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1273 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:05.427055 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-908336863", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:05.652379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] validate_networks() for [('f39fe23b-2a86-42fb-8f1f-eed84bd4ed4f', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:42:06.105665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:06.106423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:06.142942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:06.143351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:06.146175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:06.146559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:06.495039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:06.513487 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7726e766-c180-4e7a-a05a-0cd03fd4514f tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1273 microversion: 2.1 time: 0.413020 May 17 15:42:06.517790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 4/14] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:06 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1273 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:07.533240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:07.533930 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:07.561672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:07.568712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:07.571628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:07.574714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:08.333241 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:08.347146 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ba81d371-3323-4bfc-b53a-47ed1791405e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1273 microversion: 2.1 time: 0.818093 May 17 15:42:08.351094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 5/15] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:07 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1273 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:09.075045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9ba4ce06-2d9e-47e1-a807-f6276e46fe82 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: .version_select at 0x7f83fc0ac0d0>, body: {"keypair": {"name": "tempest-keypair-1379606882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjD2fvGYiOxtAg57R5GhGlL+VU11K3Lqd3gmtawQnjChesHa87QxSu8uDzWFLcSuDbR1L824JbJJpZiJmx8obKzVkHnJsmhnbsGSdJF29AffmacV4grwvCujV3nh/UC3g=="}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:09.126922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-9ba4ce06-2d9e-47e1-a807-f6276e46fe82 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:09.140799 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-9ba4ce06-2d9e-47e1-a807-f6276e46fe82 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:09.241572 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9ba4ce06-2d9e-47e1-a807-f6276e46fe82 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.887560 May 17 15:42:09.262077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 6/16] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:42:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:42:09.368083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:09.369536 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:09.391318 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:09.392382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:09.393402 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:09.394032 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:09.919486 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:09.932676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-517fb3f9-ed1c-4e55-8f6e-64a0cad51efa tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.568095 May 17 15:42:09.934199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 7/17] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:09 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:09.940834 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-285775349", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16bc5678-13ce-4abe-8c13-1d4cfd08569f"}], "security_groups": [{"name": "tempest-securitygroup--1923389534"}], "key_name": "tempest-keypair-696945681", "user_data": "}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:10.098753 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] validate_networks() for [('16bc5678-13ce-4abe-8c13-1d4cfd08569f', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:42:11.206616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:42:11.208884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:42:11.210266 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:42:11.211018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:42:11.213379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:42:11.252139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:11.253820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:11.255465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:11.257983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:11.376586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:11.401610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for user b40c7b11fff443fa8c78e8647703e230 and project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:11.441214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:42:11.449440 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:42:11.705238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dac0f82e-5247-42a7-a3f8-491a8463fb4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.932643 May 17 15:42:11.718995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 11/18] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:42:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 6949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:42:11.754833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:11.761330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:11.788435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:11.791765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:11.800718 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:11.807810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:12.638992 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:42:12.640169 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:42:12.640871 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:42:12.641579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:42:12.642248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:42:12.661522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:12.664445 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:12.668834 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:12.669292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:12.759956 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for project bf36f753be81486182665056a949849c. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:12.777847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for user 2e4972b781b043f69740342fde4efa73 and project bf36f753be81486182665056a949849c. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:12.817515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:42:12.821639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:42:12.999456 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-316e4f32-0e33-4cbd-ad1b-924f5e3416af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.063753 May 17 15:42:13.002973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 8/19] 10.222.0.75 () {62 vars in 1187 bytes} [Tue May 17 15:42:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 3068 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 15:42:13.043514 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c5f7efc1-d0a6-45ee-865f-541fa2683909 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:13.044160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c5f7efc1-d0a6-45ee-865f-541fa2683909 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:13.388712 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:13.402749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c6e03d65-afa5-4b12-a40f-db5b76467bf5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 1.678956 May 17 15:42:13.406708 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 12/20] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:11 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:13.420116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a88d0180-81b9-4520-ab3a-5a0c6b819427 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:13.421104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a88d0180-81b9-4520-ab3a-5a0c6b819427 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:13.424258 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c5f7efc1-d0a6-45ee-865f-541fa2683909 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:13.445373 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c5f7efc1-d0a6-45ee-865f-541fa2683909 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1221 microversion: 2.1 time: 0.440969 May 17 15:42:13.460989 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 9/21] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:13 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1221 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:13.768914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1390047211", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:13.793273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a88d0180-81b9-4520-ab3a-5a0c6b819427 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:13.809019 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a88d0180-81b9-4520-ab3a-5a0c6b819427 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:13.812226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a88d0180-81b9-4520-ab3a-5a0c6b819427 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:13.820087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a88d0180-81b9-4520-ab3a-5a0c6b819427 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1280 microversion: 2.20 time: 0.409877 May 17 15:42:13.822681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 13/22] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:13 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1280 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:13.918519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] validate_networks() for [('f39fe23b-2a86-42fb-8f1f-eed84bd4ed4f', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:42:14.052988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1129445473", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "670d118c-c4c6-4faf-9e34-d28bf36911ac"}], "security_groups": [{"name": "tempest-securitygroup--2106648048"}], "key_name": "tempest-keypair-1379606882", "user_data": "}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:14.941358 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] validate_networks() for [('670d118c-c4c6-4faf-9e34-d28bf36911ac', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:42:15.869766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:42:15.870414 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:42:15.870690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:42:15.871106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:42:15.871526 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:42:15.891067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:15.891748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:15.892710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:15.893313 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:15.945692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:15.958412 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for user b40c7b11fff443fa8c78e8647703e230 and project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:15.991112 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:42:15.993621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:42:16.121170 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5a751876-b379-4a8c-8304-ad2d09d4b1c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.372792 May 17 15:42:16.123757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 10/23] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:42:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:42:16.138573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:16.139762 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:16.148892 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:16.149361 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:16.150235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:16.150849 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:16.684021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:16.701180 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1eb9108e-8fc2-493f-8083-41c0d00f8351 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.572436 May 17 15:42:16.705967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 11/24] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:16 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:16.725160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:16.727235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:16.745380 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:16.746517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:16.748739 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:16.750783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:16.848323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:42:16.850222 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:42:16.851347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:42:16.852938 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:42:16.854484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:42:16.865164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:16.866256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:16.867298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:16.867829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:16.892998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:42:16.894639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:16.898846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:42:16.903640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:16.912086 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:16.916406 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8f0d97cd-8abd-4d27-bc67-6d8f4c70f541 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.209080 May 17 15:42:16.917191 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:42:16.917983 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 12/25] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:16 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:16.919982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:42:16.927453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-dfceb14d-d751-4c91-9c8c-04dde014591e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:16.941319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-dfceb14d-d751-4c91-9c8c-04dde014591e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:17.023751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-dfceb14d-d751-4c91-9c8c-04dde014591e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:17.028237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2532ae7b-28ab-470e-9422-d38782fd992e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.979932 May 17 15:42:17.029415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 14/26] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:42:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:42:17.040490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-dfceb14d-d751-4c91-9c8c-04dde014591e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1222 microversion: 2.1 time: 0.119060 May 17 15:42:17.058385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 13/27] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:16 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:17.063342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d2bf05aa-d7b0-4f46-9893-94793b637e4a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:17.063972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d2bf05aa-d7b0-4f46-9893-94793b637e4a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:17.119045 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-e62d95a4-3bcc-47ea-a61f-a6750dc1b83c req-684932bc-220e-4d6c-98b9-5d058cbfcf59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7797a3e2-eeb5-44a3-8026-daa018079937", "tag": "64187337-3bb7-410e-8b83-1eed22758592"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:17.145346 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e62d95a4-3bcc-47ea-a61f-a6750dc1b83c req-684932bc-220e-4d6c-98b9-5d058cbfcf59 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.150987 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e62d95a4-3bcc-47ea-a61f-a6750dc1b83c req-684932bc-220e-4d6c-98b9-5d058cbfcf59 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.176973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d2bf05aa-d7b0-4f46-9893-94793b637e4a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:17.183929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-e62d95a4-3bcc-47ea-a61f-a6750dc1b83c req-684932bc-220e-4d6c-98b9-5d058cbfcf59 service nova] Creating event network-changed:64187337-3bb7-410e-8b83-1eed22758592 for instance 7797a3e2-eeb5-44a3-8026-daa018079937 on hv-cinder-84212 May 17 15:42:17.184251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d2bf05aa-d7b0-4f46-9893-94793b637e4a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1242 microversion: 2.1 time: 0.124723 May 17 15:42:17.184828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 14/28] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:17 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:17.185357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e62d95a4-3bcc-47ea-a61f-a6750dc1b83c req-684932bc-220e-4d6c-98b9-5d058cbfcf59 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123909) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 15:42:17.186756 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.187408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.188409 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.189066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.201981 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.compute.rpcapi [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 15:42:17.203784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] Releasing lock "compute-rpcapi-router" {{(pid=123909) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 15:42:17.222407 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-44ab1fc1-8b77-45ae-9991-7b4bd2a8c37f None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191270 May 17 15:42:17.233881 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 15/29] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:42:17.720752 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:17.722043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:17.729662 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.730080 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.731107 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.731795 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.939320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:17.940713 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:17.947833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.948533 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.949476 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:17.950833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:17.999243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:18.008909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-94686b85-4ef2-489c-bfc8-27ee1bc7b3b4 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.291886 May 17 15:42:18.010457 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 15/30] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:17 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:18.034952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:18.054660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:18.056264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:18.056832 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:18.057624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:18.058052 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-42bc2af0-2ced-4c03-8ac9-029327ee635e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.122781 May 17 15:42:18.060586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 16/31] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:17 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:18.075250 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:18.076442 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:18.077390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:18.077984 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:18.162305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:18.172132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-49d39e74-99ce-42b4-af1f-9c0dbdad5f80 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.118656 May 17 15:42:18.181641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 16/32] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:18 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:18.201772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:18.202434 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:18.208797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:18.209477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:18.210563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:18.211208 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:18.307990 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:18.340831 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7b96ec40-b910-48d7-8c31-c95956aa1690 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.142765 May 17 15:42:18.350765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 17/33] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:18 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:19.027174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:19.028074 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:19.041158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.041158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.042153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.042352 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.078468 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:19.079906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:19.087927 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.088724 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.089850 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.090395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.216313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:19.228538 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:19.239149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:19.240329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a3139d94-e487-49e6-9742-58a46059553b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.166568 May 17 15:42:19.263237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 18/34] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:19 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:19.268188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:19.268794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:19.284317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.285023 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.286024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.286636 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.328865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:19.339009 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1504fc80-e556-48bd-bb3a-62baa5f7c4c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.316394 May 17 15:42:19.339876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 17/35] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:19 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:19.364064 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:19.365000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:19.374300 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.375139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.376252 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:19.377041 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:19.407377 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:19.430511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-19a7345a-fa8a-4792-baab-1949bcdb3952 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.165903 May 17 15:42:19.432054 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 19/36] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:19 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:19.474303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:19.483580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6026da9e-731e-4610-9c59-0fa4f1885a64 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.124889 May 17 15:42:19.484152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 18/37] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:19 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:20.259908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:20.260630 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:20.267717 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.268402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.269294 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.269923 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.357900 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:20.358637 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:20.365797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.366584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.368139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.368763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.456011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:20.473334 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:20.476096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:20.479532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-30cc1aa4-9b27-4826-809c-ebd43cd6608b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.222095 May 17 15:42:20.482798 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 20/38] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:20 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:20.487326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:20.488104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:20.496476 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.497018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.497909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.498508 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.597867 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:20.608012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-694d75e7-2153-4f76-9bc2-8d336256070a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.124103 May 17 15:42:20.610948 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 21/39] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:20 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:20.621736 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:20.623804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:20.638962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.639709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.640883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:20.642802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:20.756070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:20.760659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:20.768132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4d531587-5944-42a9-a6a7-927df565986d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.412130 May 17 15:42:20.768829 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 19/40] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:20 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:20.778746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7a3b6c3d-79aa-4ae3-a659-3fbff3ceec4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.155960 May 17 15:42:20.780401 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 22/41] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:20 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:21.500481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:21.501721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:21.508045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.508830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.510490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.511187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.586858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:21.595309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:21.597092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:21.598615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-12a1fdc8-c585-4c23-8985-1b18b1b92cc8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.102415 May 17 15:42:21.609300 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 20/42] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:21 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:21.628982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:21.629599 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:21.643414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.643873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.645193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.645193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.772320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:21.784346 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dbe0e700-a798-4fbc-874a-4d44bd68cda7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.159261 May 17 15:42:21.784728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:21.785543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:21.795634 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.795821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 23/43] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:21 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:21.798459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.800703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.801031 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:21.801939 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:21.811944 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.844904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.845678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.846581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:21.847687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:21.985180 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:21.993127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-81331667-dd58-4f6a-a7c9-859c4fa76230 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.196174 May 17 15:42:21.994363 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 24/44] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:21 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:22.065323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:22.073461 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-13b5ff77-3ee6-458c-bdf9-e82d8b9554d5 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.292572 May 17 15:42:22.074208 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 21/45] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:21 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:22.617567 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:22.618245 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:22.625210 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:22.625966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:22.626995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:22.627669 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:22.701605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:22.734963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:22.736762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:22.738781 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0dbf166e-d448-4786-838f-73376efa587d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.125792 May 17 15:42:22.739340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 25/46] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:22 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:22.802954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:22.804240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:22.810367 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:22.810859 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:22.811649 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:22.812093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:22.878328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:22.887279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d8da9e25-19d8-42da-a177-3e5f85cbc953 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.088993 May 17 15:42:22.893379 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 22/47] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:22 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:23.011466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:23.012719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:23.020328 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.021617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.022937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.023610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.098025 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:23.098025 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:23.098609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.098893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.101674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.104283 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.119703 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:23.129679 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-233b6d64-6c50-4d4b-a0f6-a4a43b148815 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.122737 May 17 15:42:23.130684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 26/48] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:23 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:23.302581 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:23.316109 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-df0a13c7-8292-4763-bdc3-8141efbdbb52 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.230628 May 17 15:42:23.322262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 23/49] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:23 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:23.756694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:23.757872 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:23.765165 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.765718 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.766537 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.766964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.833298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:23.841605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:23.843149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:23.844259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2f8f8b16-a6ab-4e3b-bee6-5bb5784f9880 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.091436 May 17 15:42:23.845022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 27/50] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:23 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:23.910956 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:23.911759 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:23.919284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.919808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.920799 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:23.921241 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:23.984560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:23.991783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-63c30328-9304-4c66-bd02-a607a619da5d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.085445 May 17 15:42:23.992355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 24/51] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:23 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:24.147485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:24.148139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:24.154243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:24.154698 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:24.155468 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:24.155908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:24.214437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:24.221655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-48a7a8e5-0eff-4048-b401-0d35ac87118a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.078041 May 17 15:42:24.222270 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 28/52] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:24 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:24.333037 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:24.333683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:24.339684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:24.340137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:24.340905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:24.341345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:24.466580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:24.473767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4989ba91-b10b-4522-8127-bd2eefbd6fa6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.144532 May 17 15:42:24.474354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 25/53] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:24 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:24.863498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:24.864107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:24.870352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:24.870866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:24.871592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:24.872023 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:24.936561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:24.944249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:24.945769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:24.947377 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5a511c68-84f9-4b54-879a-d23bb9041f6d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.087851 May 17 15:42:24.947939 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 29/54] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:24 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:25.008453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:25.009566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:25.015451 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.015905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.016679 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.017116 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.076419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:25.083649 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-06390f7f-ad5f-4ed9-bbe6-58c53b491d77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.078974 May 17 15:42:25.084222 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 26/55] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:25 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:25.239019 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:25.239661 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:25.246127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.246575 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.247343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.247776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.307197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:25.314380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-51adb9b8-26c6-46c6-a4c4-31e4c9b97fb4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.079194 May 17 15:42:25.314952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 30/56] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:25 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:25.491160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:25.491699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:25.498337 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.498791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.499560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.499998 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.626923 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:25.634263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-03a4259c-3d85-4823-af2e-b1671dcb8a69 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.146979 May 17 15:42:25.634826 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 27/57] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:25 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:25.965880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:25.966530 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:25.972628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.973077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:25.973874 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:25.974358 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.036007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:26.045448 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:26.047042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:26.048186 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e18cf33d-cc51-4277-95cf-b13b3f6ae6e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.086777 May 17 15:42:26.048784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 31/58] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:25 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:26.100635 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:26.101255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:26.108163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:26.108617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.109391 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:26.109831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.168847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:26.176065 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cfda3eb4-b5ce-4283-b0bc-5e8a14356c8b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.079275 May 17 15:42:26.176634 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 28/59] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:26 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:26.331558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:26.332095 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:26.338591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:26.339042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.339810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:26.340245 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.399319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:26.407221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0be976a9-8378-4241-9674-1e5a1f4335f0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.079669 May 17 15:42:26.407786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 32/60] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:26 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:26.650824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:26.651440 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:26.657199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:26.657652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.658450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:26.658885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:26.799176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:26.806265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d76c8c34-0380-4a01-b02c-7b2e9c685885 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.159173 May 17 15:42:26.807327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 29/61] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:26 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:27.068134 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:27.069235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:27.077869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.078637 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.079886 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.080574 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.151164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:27.158872 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:27.160375 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:27.161462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7db27c92-3093-4910-b286-3b679b3c1047 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.098134 May 17 15:42:27.162037 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 33/62] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:27 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:27.192449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:27.193060 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:27.198949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.199398 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.200162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.200594 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.260030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:27.267192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bdeb081f-be60-40c0-8123-3ea0ad1e79fa tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.078518 May 17 15:42:27.267761 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 30/63] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:27 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:27.423940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:27.424556 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:27.430536 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.430989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.431763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.432199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.493099 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:27.500405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e36d3d57-6f04-416d-897b-59dbf4e3e465 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1246 microversion: 2.1 time: 0.080272 May 17 15:42:27.500971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 34/64] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:27 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:27.824065 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:27.824678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:27.830697 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.831168 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.831929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:27.832362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:27.957263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:27.965085 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-228fca62-8a3f-4f67-a238-2b8ae57dcd0e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.145406 May 17 15:42:27.965648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 31/65] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:27 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:28.184396 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:28.186619 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:28.199355 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.200386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.202518 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.203513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.284858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:28.286290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:28.295828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.297366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.299267 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.300751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.311297 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:28.326129 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:28.328916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:28.330166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dcb95ab2-338b-4132-a21e-8a678731d9ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1284 microversion: 2.20 time: 0.151642 May 17 15:42:28.341634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 35/66] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:28 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:28.517286 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:28.517949 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:28.527053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.527513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.528312 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.534991 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.632069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:28.639307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f84f1dfb-2ccb-495d-bed7-bcbd53c4ae48 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1226 microversion: 2.1 time: 0.358502 May 17 15:42:28.639885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 32/67] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:28 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1226 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:28.673769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:28.681341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f5108a96-3802-48d4-a152-80a126bed09a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1238 microversion: 2.1 time: 0.168151 May 17 15:42:28.682824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 36/68] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:28 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1238 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:28.981378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:28.982035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:28.987862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.988301 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:28.989050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:28.989476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:29.122321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:29.129657 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-190a9151-7d2e-4203-b27c-5ec9ee960c25 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.152081 May 17 15:42:29.130264 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 33/69] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:28 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:29.348000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:29.348610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:29.355199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:29.355646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:29.356400 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:29.356831 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:29.418922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:29.427177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:29.428685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:29.429826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a4620f02-f15f-4dde-ad8a-b90608ab7ed5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1340 microversion: 2.20 time: 0.085676 May 17 15:42:29.430580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 37/70] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:29 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1340 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:29.658304 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:29.659469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:29.668905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:29.676437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:29.677505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:29.678234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:29.707251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:29.707876 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:29.721281 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:29.723093 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:29.727000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:29.729572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:30.077436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:30.089906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3bdc1d2d-5061-47b5-a60b-2738dc3d8ab0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1282 microversion: 2.1 time: 0.436064 May 17 15:42:30.090578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 34/71] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:29 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1282 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:30.111088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:30.124749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-933af5fc-ab6b-4fec-b6a6-2d905442c5fc tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1312 microversion: 2.1 time: 0.430329 May 17 15:42:30.125343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 38/72] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:29 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:30.147248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:30.147790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:30.158868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:30.159329 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:30.160471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:30.173926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:30.449195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:30.449956 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:30.465683 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:30.470897 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:30.471978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:30.473766 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:30.751618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:30.761215 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:30.762959 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:30.764147 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-efa3e1cf-50e6-46be-92e2-ca8fcb8b98da tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1338 microversion: 2.20 time: 0.319365 May 17 15:42:30.764933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 39/73] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:30 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:30.911011 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:30.924766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b5c8e36b-2889-4ec7-aa3a-e17644073d19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.781312 May 17 15:42:30.926827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 35/74] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:30 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:31.109609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:31.110354 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:31.117721 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.118269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.119096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.119539 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.159244 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:31.160220 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:31.178151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.179202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.180154 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.180684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.565563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:31.579681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4273025c-c8d2-47f2-bc24-8f32ffdc9637 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1280 microversion: 2.1 time: 0.474400 May 17 15:42:31.581158 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 40/75] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:31 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1280 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:31.783004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:31.783599 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:31.789601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.790080 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.792012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.792523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.864060 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:31.873227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b2e47f92-72ba-4361-a723-0189cb61bf92 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.734865 May 17 15:42:31.873951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 36/76] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:31 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:31.903228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:31.912679 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:31.914244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:31.915468 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bb2492b6-ae3a-4259-b14a-8d46a663dee7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1338 microversion: 2.20 time: 0.136728 May 17 15:42:31.917293 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 41/77] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:31 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1338 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:31.944786 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:31.945428 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:31.951645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.952093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:31.952860 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:31.953287 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:32.243020 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:32.251383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1313dd48-013b-4ba8-b5b4-90c25221e025 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.310247 May 17 15:42:32.252206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 37/78] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:31 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:32.597016 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:32.597726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:32.605230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:32.606470 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:32.609279 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:32.610492 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:32.736841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:32.751883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5d166485-16e1-4d9c-a025-88f85d8e1103 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1280 microversion: 2.1 time: 0.158882 May 17 15:42:32.753451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 42/79] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:32 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:32.890674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:32.892695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:32.901303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:32.902136 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:32.903265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:32.903772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:32.936375 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:32.937066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:32.943848 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:32.944852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:32.946255 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:32.947689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:33.130321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:33.139887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-615edc01-e73e-4013-a8a2-897ba9507269 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.253039 May 17 15:42:33.140592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 38/80] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:32 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:33.152320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:33.160581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:33.162140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:33.163255 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c2170a74-3941-4c83-aa38-7cbf41ac880e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.231882 May 17 15:42:33.163821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 43/81] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:32 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:33.268757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:33.269366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:33.275371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:33.275818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:33.276578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:33.277068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:33.407573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:33.414969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c5756611-9e53-4de3-b32b-b88f64a72277 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.150246 May 17 15:42:33.415537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 39/82] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:33 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:33.771083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:33.771814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:33.779214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:33.779943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:33.781419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:33.782198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:33.916969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:33.924502 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0c166244-b749-4582-985d-d331aefbcef3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.158976 May 17 15:42:33.925580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 44/83] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:33 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:34.156743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:34.157362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:34.164481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.164936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.166162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.166898 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.182399 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:34.183280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:34.191094 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.199601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.200649 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.201090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.428098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:34.437177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:34.439274 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:34.440419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-418fd93f-30ef-4b25-853d-7cbd2c75c46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.262768 May 17 15:42:34.441000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 45/84] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:34 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:34.465247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:34.472618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-01487e25-91bc-4cd0-b4e6-3a49f25da70c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.319720 May 17 15:42:34.473214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 40/85] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:34 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:34.478083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:34.479396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:34.485418 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.485869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.486668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.487101 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.513540 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-257f4924-eeb9-4139-ae7b-80441763f0d3 req-6a67ebb3-94ee-4f71-bb1f-ec7a94d66edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce6ee7f-d1fd-4950-b2b2-6504004d5e01", "tag": "83c15363-afe5-4cf3-81f7-17976151a63d"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:34.521446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-257f4924-eeb9-4139-ae7b-80441763f0d3 req-6a67ebb3-94ee-4f71-bb1f-ec7a94d66edf service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.521961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-257f4924-eeb9-4139-ae7b-80441763f0d3 req-6a67ebb3-94ee-4f71-bb1f-ec7a94d66edf service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.532781 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-257f4924-eeb9-4139-ae7b-80441763f0d3 req-6a67ebb3-94ee-4f71-bb1f-ec7a94d66edf service nova] Creating event network-changed:83c15363-afe5-4cf3-81f7-17976151a63d for instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 on hv-cinder-84212 May 17 15:42:34.537629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-257f4924-eeb9-4139-ae7b-80441763f0d3 req-6a67ebb3-94ee-4f71-bb1f-ec7a94d66edf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095532 May 17 15:42:34.538244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 46/86] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:42:34.624854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:34.632176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ebd8b3ff-8d60-4b94-80b1-1d46ec090e70 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.158018 May 17 15:42:34.632740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 41/87] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:34 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:34.941824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:34.942561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:34.949563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.950043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:34.950820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:34.951262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:35.305183 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:35.313295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a290ad62-9e35-44e1-9cf0-19cc9f530813 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.375793 May 17 15:42:35.322642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 47/88] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:34 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:35.459423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:35.460040 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:35.466329 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:35.466779 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:35.467564 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:35.468003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:35.490370 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:35.490998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:35.498066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:35.498533 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:35.499335 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:35.499779 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:36.005503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:36.014518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:36.017166 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:36.017713 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:36.019327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6c366ffb-27c2-4312-8bfe-21288dc9c39c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.563215 May 17 15:42:36.028844 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-228a0e4e-1b45-43ab-975d-02f2f8eb36b9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.542404 May 17 15:42:36.031669 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 42/89] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:35 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:36.036650 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:36.037458 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:36.039685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 48/90] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:35 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:36.046082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:36.046554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:36.047368 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:36.047977 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:36.330154 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:36.330773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:36.340101 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:36.341022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:36.342239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:36.342835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:36.451484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:36.460292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-232a6871-c410-41e9-a7b0-b743fa6c4854 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.427293 May 17 15:42:36.470383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 43/91] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:36 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:36.771128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:36.779561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6e5da28f-0e3c-4613-8b8d-69247365c71c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.453165 May 17 15:42:36.780139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 49/92] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:36 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:37.038726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:37.039269 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:37.045659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.046163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.046927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.047496 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.048272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:37.049300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:37.056554 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.057015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.057805 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.058505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.396069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:37.405173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3e7bf2be-db36-48d8-968a-3e16852b622e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.361523 May 17 15:42:37.406421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 50/93] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:37 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:37.409344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:37.419027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-ecf19097-74f0-4be3-9ab1-c1aaee6aa17b req-e8465498-02c3-4c89-9e69-e8f8c6a1601e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e592f5a-3f22-48bd-b517-5ddd4d5c2503", "tag": "41b61a96-78fb-4784-84f7-a1553b8a3cee"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:37.419183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:37.420857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:37.423143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9fd0337f-2ed3-414f-a699-a73e91b96673 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.387709 May 17 15:42:37.426487 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 44/94] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:37 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:37.430268 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ecf19097-74f0-4be3-9ab1-c1aaee6aa17b req-e8465498-02c3-4c89-9e69-e8f8c6a1601e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.430784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ecf19097-74f0-4be3-9ab1-c1aaee6aa17b req-e8465498-02c3-4c89-9e69-e8f8c6a1601e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.444160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-ecf19097-74f0-4be3-9ab1-c1aaee6aa17b req-e8465498-02c3-4c89-9e69-e8f8c6a1601e service nova] Creating event network-changed:41b61a96-78fb-4784-84f7-a1553b8a3cee for instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 on hv-cinder-84212 May 17 15:42:37.449983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-ecf19097-74f0-4be3-9ab1-c1aaee6aa17b req-e8465498-02c3-4c89-9e69-e8f8c6a1601e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042046 May 17 15:42:37.450619 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 51/95] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:42:37.476943 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:37.479265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:37.485455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.486151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.486933 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.487374 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.627403 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:37.635817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2100e2da-10a7-4bfd-ab07-d3bd51d0287b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.162892 May 17 15:42:37.636524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 45/96] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:37 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:37.796614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:37.797249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:37.803780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.804236 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.805006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:37.806195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:37.952194 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:37.959934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-88473d6b-3de3-46c6-ae14-aba5fc7c9511 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.167531 May 17 15:42:37.960664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 52/97] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:37 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:38.422484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:38.423063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:38.428853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.429283 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.430059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.430489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.440580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:38.441200 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:38.447141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.447595 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.448371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.448814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.621861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:38.628311 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:38.629327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bb7311aa-d764-449d-a22e-f1d00b452284 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.210608 May 17 15:42:38.629927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 46/98] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:38 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:38.636127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:38.637639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:38.638765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-484b1559-5365-4fcf-89a3-70d4f80488c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.202132 May 17 15:42:38.639314 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 53/99] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:38 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:38.652901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:38.653563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:38.659997 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.660548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.661381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.661820 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.789526 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:38.797181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e556e904-99eb-4253-90ab-6a9d02b0bbd8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.148600 May 17 15:42:38.797744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 47/100] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:38 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:38.976777 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:38.977323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:38.983761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.984244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:38.985000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:38.985434 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.116963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:39.124852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4177a468-463a-428e-8443-1b28812bc5a9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.152249 May 17 15:42:39.125420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 54/101] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:38 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:39.464201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a844700c-49ee-41b1-8eda-4d007aba32d7 req-8737234b-929b-49a6-b33a-de1fbfd6353c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}, {"name": "network-changed", "server_uuid": "73cc19bf-e9b1-4087-bffb-757df05d29e5", "tag": "d88db692-f314-4035-ad7b-ca49d3a51b36"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:39.475740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a844700c-49ee-41b1-8eda-4d007aba32d7 req-8737234b-929b-49a6-b33a-de1fbfd6353c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.476183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a844700c-49ee-41b1-8eda-4d007aba32d7 req-8737234b-929b-49a6-b33a-de1fbfd6353c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.496575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a844700c-49ee-41b1-8eda-4d007aba32d7 req-8737234b-929b-49a6-b33a-de1fbfd6353c service nova] Creating event network-changed:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:42:39.497090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a844700c-49ee-41b1-8eda-4d007aba32d7 req-8737234b-929b-49a6-b33a-de1fbfd6353c service nova] Creating event network-changed:d88db692-f314-4035-ad7b-ca49d3a51b36 for instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 on hv-cinder-84212 May 17 15:42:39.497620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a844700c-49ee-41b1-8eda-4d007aba32d7 req-8737234b-929b-49a6-b33a-de1fbfd6353c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 15:42:39.498717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.499163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.499955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.500389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.509058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.compute.rpcapi [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 15:42:39.510582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] Releasing lock "compute-rpcapi-router" {{(pid=123908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 15:42:39.527523 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8b1fe5c1-fb04-41b0-a632-e455e01a15fc None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066858 May 17 15:42:39.528110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 48/102] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:42:39.646430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:39.646961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:39.653134 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.653613 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.654405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.654850 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.656677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:39.657557 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:39.663780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.664291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.665106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.665551 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.849219 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:39.858075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3de3d996-bd08-4395-b003-07a4f1bc0122 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.215559 May 17 15:42:39.858752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 55/103] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:39 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:39.859441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:39.863469 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:39.864966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:39.873899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:39.873899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:39.873899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-29b93b89-d50b-4f03-9e19-d1e48299061d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.221470 May 17 15:42:39.882522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 49/104] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:39 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:39.882614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.882614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:39.882614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:39.882614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:40.013145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:40.020633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fc839c33-02de-4605-9de7-a4542da20d9d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.160906 May 17 15:42:40.021207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 56/105] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:39 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:40.141335 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:40.142071 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:40.148012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:40.148459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:40.149217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:40.149650 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:40.277503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:40.284865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e4ed8f80-43d1-4fa1-8383-a3708fdab87d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.147337 May 17 15:42:40.285441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 50/106] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:40 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:40.876425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:40.877671 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:40.884207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:40.885217 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:40.886514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:40.886976 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:40.897424 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:40.898409 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:40.907270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:40.907958 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:40.909160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:40.909684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:41.079608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:41.086951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f5e1ac62-bdeb-46ab-a5f1-13b86afbf010 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.214446 May 17 15:42:41.090718 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:41.095056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 57/107] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:40 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:41.099068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:41.100753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:41.100887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:41.101878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:41.102245 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4e01e738-9d61-4b2a-a9b5-99be47004b15 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.210645 May 17 15:42:41.103252 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 51/108] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:40 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:41.111368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:41.111836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:41.112622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:41.113072 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:41.254255 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:41.261835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5cadb223-8a76-4560-87e2-b4b12b464838 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.165520 May 17 15:42:41.262472 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 58/109] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:41 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:41.301818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:41.302471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:41.308947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:41.309400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:41.310200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:41.310640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:41.439162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:41.446576 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1f7458a1-b43f-403a-92c3-83616f998c95 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.148462 May 17 15:42:41.447413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 52/110] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:41 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:42.104272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:42.105141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:42.111155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.111602 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.112379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.112810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.123534 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:42.125295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:42.133053 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.133670 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.134912 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.135725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.363889 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:42.373137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-176aad0b-cda7-4225-8a94-4f27b517bfc1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.273267 May 17 15:42:42.373626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 59/111] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:42 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:42.386942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:42.388978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:42.404906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.405601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.406568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.407216 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.858054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:42.874949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:42.876895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:42.878296 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-433f97c6-987a-4d3c-8205-0cb70c4dfe85 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.761391 May 17 15:42:42.879337 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 53/112] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:42 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:42.887310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:42.888165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:42.895980 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.896715 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:42.897692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:42.898440 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:43.071025 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:43.079623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-cd86289a-134e-4b51-9e9a-77a26d1f23a9 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.701294 May 17 15:42:43.080501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 60/113] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:42 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:43.124009 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:43.131847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1fb88417-db57-40cc-8042-e51eb2d56ce5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.250910 May 17 15:42:43.132376 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 54/114] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:42 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:43.392629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:43.393746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:43.401114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:43.402204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:43.403322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:43.403701 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:43.539873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:43.547635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-76ee4bd8-052a-4ecf-af0a-989d3b575b71 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.159941 May 17 15:42:43.548212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 61/115] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:43 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:43.896497 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:43.897228 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:43.903150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:43.903685 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:43.904519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:43.905026 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.043706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:44.052234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:44.053783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:44.054935 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9c8b3657-e242-4a43-907b-86e52e1b6dd7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.162258 May 17 15:42:44.056548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 55/116] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:43 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:44.097380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:44.098012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:44.107487 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:44.108166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.109420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:44.110162 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.148597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:44.149734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:44.155657 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:44.156115 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.156894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:44.157336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.295780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:44.304254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ab66a2e2-6e95-46d8-b3e1-88b2ab0e32ec tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.210811 May 17 15:42:44.305077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 62/117] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:44 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:44.327874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:44.335571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ca33bae5-166f-4bfd-99f4-4b2dbf39a22b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.190767 May 17 15:42:44.336229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 56/118] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:44 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:44.564476 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:44.565085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:44.570887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:44.571291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.572057 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:44.572476 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:44.704440 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:44.712046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1f70f3f8-7717-487e-888a-ab4e2091ad5f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.151391 May 17 15:42:44.713316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 63/119] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:44 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:45.072930 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:45.073535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:45.079814 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.080268 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.081045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.081470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.213841 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:45.221630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:45.223188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:45.224285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-65c55c37-f2c1-442e-8817-7b0cfc662cd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.155781 May 17 15:42:45.224852 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 57/120] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:45 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:45.321474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:45.322651 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:45.328462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.328915 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.329693 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.330160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.352184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:45.353105 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:45.359189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.359755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.360833 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.361329 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.512436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:45.522692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-173330e2-218e-4c40-9974-b39b4323c0fc tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.204872 May 17 15:42:45.523657 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 64/121] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:45 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:45.540874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:45.548199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ffe93258-d5cd-4a2e-b30c-0bd505db2872 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.200280 May 17 15:42:45.548790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 58/122] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:45 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:45.729967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:45.730929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:45.737198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.738306 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.739114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:45.739836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:45.888986 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:45.896205 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4a3d6651-4b6f-4e36-9643-fcd510ccf616 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.171384 May 17 15:42:45.896774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 65/123] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:45 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:46.242423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:46.243068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:46.249210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.249661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.250459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.250964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.380230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:46.388010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:46.389515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:46.390652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-798efa1b-54ae-4d7c-9ea0-6c0691a34a6e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.152146 May 17 15:42:46.391216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 59/124] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:46 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:46.540004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:46.540720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:46.547122 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.547580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.548361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.548797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.564443 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:46.565056 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:46.570872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.571323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.572598 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.573033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.734298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:46.742990 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f584905d-d6e6-43b8-b121-db1321184078 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.206937 May 17 15:42:46.743569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 66/125] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:46 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:46.745058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:46.752500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ce1283d2-ed64-468c-87c3-72057aba853b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.191771 May 17 15:42:46.752996 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 60/126] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:46 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:46.912345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:46.912960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:46.918776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.919230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:46.919997 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:46.920435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:47.044450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:47.051697 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d3ad084a-e6b6-4f99-9fe9-5c3b5d0449d2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.143094 May 17 15:42:47.052272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 67/127] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:46 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:47.408897 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:47.410178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:47.416805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:47.417513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:47.418499 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:47.419091 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:47.643852 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:47.652063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:47.653593 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:47.654723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6f67e5e3-18db-45ec-afc9-c6c6fc8604b7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.249744 May 17 15:42:47.655290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 61/128] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:47 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:47.759758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:47.760543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:47.767015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:47.767488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:47.768274 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:47.768722 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:47.769148 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:47.770119 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:47.777083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:47.777713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:47.778553 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:47.778994 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:48.091470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:48.095850 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:48.102539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-de2f1b99-08b5-451c-bfaa-4780be90d26f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.337407 May 17 15:42:48.110366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 62/129] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:47 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:48.110671 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-32937de6-00c4-4579-955e-3d08e6d4e0dd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.348984 May 17 15:42:48.110797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:48.110797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:48.115177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:48.115420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 68/130] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:47 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:48.115722 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:48.116522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:48.116963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:48.343483 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:48.351338 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-fa07f9ab-6e63-4b60-a6eb-da7396183d2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.247172 May 17 15:42:48.352167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 63/131] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:48 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:48.672628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:48.673236 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:48.679169 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:48.679613 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:48.680379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:48.680838 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:48.809560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:48.817647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:48.819271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:48.820384 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-07ce174c-2340-4dd7-99fb-083f4ce69abb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.151646 May 17 15:42:48.821280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 69/132] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:48 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:49.122399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:49.122878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:49.123257 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:49.123619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:49.131641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.132386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.133032 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.133626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.133992 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.134604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.136070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.136579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.353835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:49.357013 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:49.362877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-491a1cd6-b59e-40fb-8e04-a64adeef0035 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.244374 May 17 15:42:49.363856 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 70/133] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:49 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:49.368920 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:49.369597 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:49.375358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4ed35c2f-f1e8-4ff8-a346-4119ea21e5c0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.259108 May 17 15:42:49.376113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.376221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 64/134] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:49 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:49.376829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.377672 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.378625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.506700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:49.514192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4b3a3957-3c7f-4d62-b539-f4c04b986fd6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.149194 May 17 15:42:49.514694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 71/135] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:49 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:49.690190 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-9e1dd12e-8d62-4858-8dd8-2049f133e60c req-595dcbf2-bce9-4411-9edf-9acbb817ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7797a3e2-eeb5-44a3-8026-daa018079937", "name": "network-vif-plugged", "status": "completed", "tag": "64187337-3bb7-410e-8b83-1eed22758592"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:42:49.701091 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-9e1dd12e-8d62-4858-8dd8-2049f133e60c req-595dcbf2-bce9-4411-9edf-9acbb817ee73 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.702176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-9e1dd12e-8d62-4858-8dd8-2049f133e60c req-595dcbf2-bce9-4411-9edf-9acbb817ee73 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.715794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-9e1dd12e-8d62-4858-8dd8-2049f133e60c req-595dcbf2-bce9-4411-9edf-9acbb817ee73 service nova] Creating event network-vif-plugged:64187337-3bb7-410e-8b83-1eed22758592 for instance 7797a3e2-eeb5-44a3-8026-daa018079937 on hv-cinder-84212 May 17 15:42:49.723938 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-9e1dd12e-8d62-4858-8dd8-2049f133e60c req-595dcbf2-bce9-4411-9edf-9acbb817ee73 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098578 May 17 15:42:49.724942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 65/136] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:42:49.840610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:49.841269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:49.847426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.847876 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.848649 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:49.849089 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:49.976134 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:49.985434 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:49.987212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:49.988415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f9c98060-a278-419c-847f-de9c17017876 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.152457 May 17 15:42:49.989178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 72/137] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:49 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:50.380528 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:50.381243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:50.388592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:50.389081 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:50.390249 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:50.390689 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:50.393283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:50.394028 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:50.400015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:50.400719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:50.401701 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:50.402390 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:50.626468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:50.628806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:50.634274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6ce15f39-d49e-41ae-9827-507c72aa7baf tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.257845 May 17 15:42:50.635221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 66/138] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:50 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:50.640718 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:50.641535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:50.646695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4808fadd-bceb-43d8-98ec-415996844b6b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.257613 May 17 15:42:50.647525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 73/139] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:50 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:50.655953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:50.656451 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:50.657219 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:50.658079 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:50.789991 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:50.799071 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1699996f-8b0a-416c-acc1-3502e032f977 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.162039 May 17 15:42:50.799683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 67/140] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:50 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:51.007371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:51.008109 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:51.014676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.015119 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.015880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.016310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.142957 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:51.151826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:51.153342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:51.154484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c9160e62-4001-4a1c-9534-b7a67078559f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.151037 May 17 15:42:51.155160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 74/141] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:51 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:51.652027 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:51.652663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:51.658584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.659010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.660130 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.660571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.664800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:51.666350 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:51.672587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.673159 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.674042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.674535 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.877069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:51.880052 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:51.885112 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-71153f78-f6ab-4a7d-b1f3-a1e0fe34de2c tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.237479 May 17 15:42:51.885774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 68/142] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:51 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:51.888047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ea8ef301-4ef8-43dc-a6ac-330a6372079b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.226988 May 17 15:42:51.888601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 75/143] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:51 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:51.890531 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:51.891209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:51.896890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.897542 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:51.898341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:51.898779 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:52.022666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:52.030542 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c9c2b3f1-3347-4775-becb-b9fa77629c65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.143707 May 17 15:42:52.031134 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 69/144] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:51 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:52.172182 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:52.172808 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:52.178932 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:52.179378 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:52.180135 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:52.180562 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:52.489496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:52.498192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:52.499772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:52.500881 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dce5925f-9e32-4f3f-b3d8-45396410e485 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.332572 May 17 15:42:52.501450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 76/145] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:52 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:52.902605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:52.903335 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:52.904484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:52.905100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:52.909401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:52.909925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:52.910755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:52.910847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:52.911219 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:52.911322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:52.912014 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:52.912447 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:53.116711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:53.120258 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:53.124815 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c7431fff-d336-4c34-963c-4ea020c9409a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.224052 May 17 15:42:53.125582 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 77/146] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:52 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:53.129767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:53.130384 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:53.132678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9a34e3f9-cbc9-488a-9800-acea0e869839 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.234620 May 17 15:42:53.133266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 70/147] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:52 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:53.136702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:53.137144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:53.137903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:53.138353 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:53.265744 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:53.273351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-cc65d308-d8ea-4316-b4a8-a8627fe6c461 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.147014 May 17 15:42:53.273911 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 78/148] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:53 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:53.519021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:53.519656 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:53.525608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:53.526094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:53.526863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:53.527302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:53.650337 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:53.658128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:53.659622 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:53.660759 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8055d7ee-058c-4aab-bda4-54216f4978c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.145628 May 17 15:42:53.661301 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 71/149] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:53 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:54.141317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:54.141929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:54.148895 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.149360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.150193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.150643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.150892 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:54.151518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:54.157768 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.158261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.159044 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.159514 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.338681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:54.341947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:54.346115 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9a10a356-6732-4ecd-9f0f-dc9573f1ea38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.208513 May 17 15:42:54.346688 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 79/150] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:54 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:54.349234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6b700bb4-0340-4531-ab47-eb577a0a6624 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.204061 May 17 15:42:54.350034 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 72/151] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:54 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:54.351849 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:54.352456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:54.358361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.358816 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.359586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.360029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.484963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:54.492161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-149fd42a-02fc-40ef-a978-97e1873ff839 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.144366 May 17 15:42:54.492764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 80/152] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:54 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:54.681982 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:54.682892 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:54.689666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.690345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.691599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:54.692309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:54.842691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:54.850740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:54.853214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:54.854340 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8c84eb17-f895-497c-b4da-39fad8e0df1d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.178574 May 17 15:42:54.854902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 73/153] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:54 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:55.362551 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:55.363294 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:55.366673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:55.367366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:55.369695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.370197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.370985 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.371517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.373701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.374191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.374955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.375389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.564231 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:55.572357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:55.579177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-82ed6661-b9f5-4a8e-9eb4-56b2f9c69df0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.220746 May 17 15:42:55.579788 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 81/154] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:55 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:55.580292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2ae5300d-4e26-481c-bee9-9b62e754c076 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.217563 May 17 15:42:55.589823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 74/155] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:55 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:55.590011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:55.590011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:55.595524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.595967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.596732 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.597163 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.731590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:55.738994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f87d73c2-d20a-468e-bda4-4867df11c093 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.157946 May 17 15:42:55.739714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 82/156] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:55 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:55.871828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:55.872439 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:55.878228 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.878680 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:55.879444 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:55.879881 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.000901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:56.008698 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:56.010236 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:56.011334 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-491a50e9-5157-4d9b-84ac-1947284e05c4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.143460 May 17 15:42:56.011899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 75/157] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:55 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:56.595977 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:56.596489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:56.596858 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:56.597001 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:56.603102 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:56.603256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:56.603550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.603663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.604314 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:56.604409 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:56.604747 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.604848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.793136 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:56.795071 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:56.801885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a009e52c-130d-448b-aa2e-1d13de4846a3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.209117 May 17 15:42:56.802786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a92c19c7-c203-488e-a301-8cc28f73187d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.210641 May 17 15:42:56.803328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 76/158] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:56 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:56.804060 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 83/159] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:56 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:56.809603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:56.810673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:56.817779 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:56.818349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.819199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:56.819712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:56.947021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:56.954207 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-630faa8b-aed5-4126-9c98-7e974c2be703 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.149803 May 17 15:42:56.954778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 77/160] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:56 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:57.028766 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:57.029373 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:57.035251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:57.035700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:57.036463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:57.036901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:57.160934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:57.169402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:57.170931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:57.172034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-151ee03b-7f6c-4e1c-bebb-71a420aa7ef6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.147084 May 17 15:42:57.172588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 84/161] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:57 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:42:57.819530 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:57.820178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:57.821904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:57.822543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:57.828635 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:57.828808 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:57.829106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:57.829202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:57.829912 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:57.830783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:57.830783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:57.830962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:58.021067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:58.023884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:58.028628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d258f32f-d5e8-4a1a-a4a9-0e482974d1d3 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.212998 May 17 15:42:58.029203 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 78/162] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:57 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:58.031151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b8e4009c-8c6b-480b-a36e-7e0c9f1ced2d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.212955 May 17 15:42:58.031841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 85/163] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:57 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:58.036860 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:58.037558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:58.045810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:58.046297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:58.047076 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:58.047511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:58.183648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:58.191724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-299c1f7c-3325-41c4-b96d-bec4b1c26eb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.159248 May 17 15:42:58.192291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 79/164] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:58 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:58.192479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:58.193193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:58.199614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:58.200138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:58.201024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:58.201527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:58.329206 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:58.337926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:58.339539 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:58.340713 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f2717e84-492b-4580-8beb-0538b985e46b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.152236 May 17 15:42:58.341392 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 86/165] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:58 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:42:59.044598 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:59.045132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:59.048156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:59.048768 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:59.051065 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.051511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.052267 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.052695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.054967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.055426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.056687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.057127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.238480 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:59.241234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:59.246375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4c328917-bad2-4a29-886b-bc928c4b6022 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.205694 May 17 15:42:59.246957 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 80/166] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:59 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:59.251544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:59.252139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:59.253057 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4348e935-fa61-466a-9afd-5d81f4dc6420 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.208739 May 17 15:42:59.253964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 87/167] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:59 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:42:59.257989 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.258457 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.259215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.259643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.360317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:42:59.360924 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:42:59.366966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.367418 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.368798 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:42:59.369244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:42:59.384755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:59.394416 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9f4343a4-346c-4ffc-9a2e-e8f0e1eeb37c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.146408 May 17 15:42:59.395176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 81/168] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:42:59 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:42:59.499898 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:59.507886 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:59.509406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:42:59.510553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1bfde051-0928-484a-bdd5-05f6a88a9ee9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.155272 May 17 15:42:59.511115 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 88/169] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:42:59 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:00.034006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-10c34d55-2e22-43d7-8692-9437dbd53b04 req-48042449-e38f-4f87-b64d-b67c3a27ed7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "name": "network-vif-plugged", "status": "completed", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:00.042382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-10c34d55-2e22-43d7-8692-9437dbd53b04 req-48042449-e38f-4f87-b64d-b67c3a27ed7a service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.042917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-10c34d55-2e22-43d7-8692-9437dbd53b04 req-48042449-e38f-4f87-b64d-b67c3a27ed7a service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.054918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-10c34d55-2e22-43d7-8692-9437dbd53b04 req-48042449-e38f-4f87-b64d-b67c3a27ed7a service nova] Creating event network-vif-plugged:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:43:00.060888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-10c34d55-2e22-43d7-8692-9437dbd53b04 req-48042449-e38f-4f87-b64d-b67c3a27ed7a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 May 17 15:43:00.061511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 82/170] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:00.263357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:00.264140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:00.269711 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:00.270352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.270461 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:00.270925 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.271704 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.272144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.277029 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.277483 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.278275 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.278717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.460241 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:00.462964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:00.471977 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5023be3a-4542-4a9a-848d-de62e7f9f680 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.212785 May 17 15:43:00.472115 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b1cf2280-324f-43bc-91f2-b12f86060399 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.206413 May 17 15:43:00.481740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 83/171] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:00 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:00.482126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 89/172] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:00 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:00.486842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:00.487449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:00.493682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.494165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.494932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.495375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.529023 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:00.529663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:00.535649 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.536107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.536917 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:00.537357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:00.681409 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:00.689201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2d2b0bee-76a2-4b3b-a8d0-99fd4e0bd2c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.206162 May 17 15:43:00.689783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 84/173] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:00 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:00.705444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:00.713430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:00.714981 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:00.716083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e71d9b5c-8c51-4148-a43d-30e887b52ad3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.191649 May 17 15:43:00.716645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 90/174] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:00 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:01.495444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:01.496109 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:01.496880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:01.499684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:01.514638 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:01.516303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:01.517794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:01.517958 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:01.518828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:01.519689 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:01.521290 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:01.522879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:02.314508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:02.322992 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2f6b59db-765d-49f7-80fb-9cbb755c3939 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.837976 May 17 15:43:02.338702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:02.342151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 85/175] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:01 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:02.347450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-18e4a5be-1cd8-4fb2-a9ec-3ef5cb6377e9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.861200 May 17 15:43:02.348023 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 91/176] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:01 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:02.351964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:02.357914 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:02.358556 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:02.360868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:02.368324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:02.368778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:02.369555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:02.370021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:02.377199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:02.377647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:02.378452 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:02.378886 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:02.598286 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:02.606389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:02.607894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:02.609009 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6af6602d-ee08-4f76-a753-f1f4e2296bd9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.254951 May 17 15:43:02.609578 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 92/177] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:02 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:02.622687 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:02.630926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-feb5106f-0225-448d-a475-6d1ce20102c4 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.287700 May 17 15:43:02.631899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 86/178] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:02 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:03.340143 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:03.340751 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:03.347253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.347700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.348760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.349342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.367031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:03.368876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:03.380278 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.380846 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.381744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.382377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.614354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:03.622619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-12c852fa-3ea1-4aa6-8470-ee7ecaecfcb2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.259912 May 17 15:43:03.629573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:03.638659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e9246d9a-e4ee-49bf-808c-f0ae01263a37 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.303396 May 17 15:43:03.639272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 87/179] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:03 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:03.640098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 93/180] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:03 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:03.650729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:03.651517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:03.654320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:03.655142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:03.658961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.659693 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.660669 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.661496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.662243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.662875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.663651 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:03.664249 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:03.870069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:03.873333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:03.879523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:03.881041 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:03.882466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7336f1c0-166f-4abb-8cb1-d18bde99cf22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.241132 May 17 15:43:03.883039 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 94/181] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:03 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:03.886251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-382782eb-5d29-4a1c-89b3-27f044237c02 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.237010 May 17 15:43:03.887264 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 88/182] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:03 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:04.043015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-77edec42-89df-476e-b325-3f4bfce39f7f req-d125965b-d20a-4d9e-9a29-faebb42bc00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc19bf-e9b1-4087-bffb-757df05d29e5", "name": "network-vif-plugged", "status": "completed", "tag": "d88db692-f314-4035-ad7b-ca49d3a51b36"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:04.052594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-77edec42-89df-476e-b325-3f4bfce39f7f req-d125965b-d20a-4d9e-9a29-faebb42bc00c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.053053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-77edec42-89df-476e-b325-3f4bfce39f7f req-d125965b-d20a-4d9e-9a29-faebb42bc00c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.068535 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-77edec42-89df-476e-b325-3f4bfce39f7f req-d125965b-d20a-4d9e-9a29-faebb42bc00c service nova] Creating event network-vif-plugged:d88db692-f314-4035-ad7b-ca49d3a51b36 for instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 on hv-cinder-84212 May 17 15:43:04.077317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-77edec42-89df-476e-b325-3f4bfce39f7f req-d125965b-d20a-4d9e-9a29-faebb42bc00c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037916 May 17 15:43:04.077937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 95/183] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:04.656231 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:04.656784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:04.657411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:04.658100 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:04.665674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.666083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.666592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.667020 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.667405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.668120 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.668496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.668636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.907861 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:04.917609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f52a584c-8e37-4fa0-b6c4-d6dc582509b0 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.262712 May 17 15:43:04.926729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 96/184] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:04 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:04.931973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:04.932582 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:04.945412 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.945861 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.954532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:04.954620 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:04.976152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:04.994997 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f274e815-92de-4fb4-9ea1-0515d41464cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.342966 May 17 15:43:05.004920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 89/185] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:04 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:05.013474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:05.014124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:05.028692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:05.044899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:05.044899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:05.044899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:05.163955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:05.175035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:05.179594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:05.185153 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3bf2a7d8-942e-4db2-84ab-c985f78b31ac tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.253078 May 17 15:43:05.185790 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 97/186] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:04 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:05.243954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:05.253904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-21eba3c0-341f-4d7b-9602-a3f35420efa7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.247757 May 17 15:43:05.263729 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 90/187] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:05 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:05.933941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:05.934567 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:05.940653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:05.941172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:05.942025 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:05.942527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.013525 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:06.014963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:06.022600 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:06.023268 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.024664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:06.025476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.108133 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:06.116451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-774b62a7-2283-4f23-9938-fe5533f13611 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.186243 May 17 15:43:06.126535 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 98/188] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:05 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:06.204253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:06.205016 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:06.210973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:06.211839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.212810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:06.213478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.218113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:06.225880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5b1df485-47fc-42f6-8d02-f06a75be0992 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.217537 May 17 15:43:06.228972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 91/189] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:06 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:06.270999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:06.271615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:06.278289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:06.278951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.279885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:06.280475 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:06.437368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:06.445430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:06.447862 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:06.449396 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2c9afe2f-2fe3-40fb-8c6b-465a0739e5a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.249247 May 17 15:43:06.450255 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 99/190] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:06 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:06.475733 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:06.484180 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-303898ba-dd2a-4fcf-ba2e-d608227a6e62 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.216865 May 17 15:43:06.488667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 92/191] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:06 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:07.133416 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:07.134562 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:07.140700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.141153 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.141937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.142399 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.245129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:07.246358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:07.252175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.252620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.253382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.254073 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.409055 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:07.416972 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-037010b9-58d2-405a-bda8-35dc424a0da6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.288054 May 17 15:43:07.417547 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 100/192] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:07 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:07.468033 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:07.468983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:07.476141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.478030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.479058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.479846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.517817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:07.525942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-72b9427a-986c-4db6-9418-edf5bfbc2879 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.285162 May 17 15:43:07.526550 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 93/193] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:07 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:07.531251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:07.532187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:07.539597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.540429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.541438 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:07.541978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:07.742565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:07.751453 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:07.753010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:07.753415 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:07.754699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f37ea30f-91cc-4ebf-8f9a-cc6a58a59a43 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.290613 May 17 15:43:07.755469 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 101/194] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:07 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:07.766225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a132a7c8-26c6-499d-824e-9c6dc8e2fa1a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.235131 May 17 15:43:07.766225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 94/195] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:07 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:08.434886 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:08.435570 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:08.448950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.449436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.450282 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.450724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.543448 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:08.544647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:08.551084 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.551709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.553140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.553745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.731850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:08.749976 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3e0340e5-48ae-42c4-af9e-d2ce8773645b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.320371 May 17 15:43:08.750602 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 95/196] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:08 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:08.791770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:08.793269 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:08.801895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.802824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.804066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.806476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.820207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:08.830713 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6e651abc-1886-4e2b-9d03-ad31d9b88091 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.291514 May 17 15:43:08.831307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 102/197] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:08 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:08.845726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:08.846298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:08.864021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.866579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:08.867394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:08.868386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:09.034502 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:09.051067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:09.053113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:09.057359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c1b641a3-6513-4725-b69d-edc10730df7a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.286702 May 17 15:43:09.059394 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 96/198] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:08 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:09.069728 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:09.078435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fbdf0ec9-16e0-4a9a-84ff-47d5bce35a50 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.236385 May 17 15:43:09.079329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 103/199] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:08 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:09.767294 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:09.767908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:09.773989 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:09.774470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:09.775249 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:09.775683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:09.847438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:09.848047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:09.856237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:09.857570 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:09.858903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:09.860054 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:09.992322 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:10.000355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-53795385-0362-4cc5-85c1-5b391bdf5103 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.236813 May 17 15:43:10.003005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 97/200] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:09 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:10.052755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:10.065877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3179ec25-f2c1-4670-bac6-a76ff234d199 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.221931 May 17 15:43:10.067027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 104/201] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:09 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:10.081988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:10.082626 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:10.098954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:10.101994 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:10.102247 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:10.104648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:10.107611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:10.108069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:10.117125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:10.118247 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:10.119161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:10.124993 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:10.369231 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:10.379116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-99dc7182-f251-4b2f-8acf-94ab491f3872 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.286706 May 17 15:43:10.383465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 105/202] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:10 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:10.411123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:10.421350 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:10.423580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:10.424948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ded4b00c-41ab-47bc-92a7-4c0765db6b8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.347443 May 17 15:43:10.425723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 98/203] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:10 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:11.016456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:11.017067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:11.022969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.023415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.024244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.024685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.085034 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:11.086280 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:11.092962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.093683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.094824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.095268 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.183969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:11.191986 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-75fb7cef-12ad-46e0-84ca-fe6bb465b820 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.179358 May 17 15:43:11.192847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 106/204] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:11 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:11.247717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:11.255327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f9e15491-7998-4570-8d32-9149fcbb7e33 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.175311 May 17 15:43:11.255890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 99/205] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:11 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:11.396340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:11.396944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:11.403069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.403514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.404272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.404700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.444211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:11.444950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:11.450918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.451550 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.452503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:11.452934 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:11.590531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:11.597829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d389efc2-2856-4a0b-9d52-22ccd3ee1388 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.205517 May 17 15:43:11.598443 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 107/206] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:11 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:11.616079 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:11.625006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:11.626736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:11.627869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b3a78c49-2e73-4629-85f4-58d7a2d17663 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.187456 May 17 15:43:11.628473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 100/207] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:11 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:12.209107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:12.209688 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:12.215749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.216204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.216967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.217415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.271955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:12.272559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:12.279551 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.280008 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.280778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.281216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.398331 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:12.406323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1575de04-923d-4200-9112-b97f2086b140 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1315 microversion: 2.1 time: 0.201118 May 17 15:43:12.407053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 108/208] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:12 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:12.439504 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:12.446770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ed44204a-d4e7-4134-bee2-81c1ca2e49ea tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.178605 May 17 15:43:12.447333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 101/209] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:12 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:12.614812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:12.615421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:12.621262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.621737 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.622523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.622956 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.646688 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:12.647377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:12.653784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.654270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.655039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:12.655472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:12.808239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:12.817687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ac878a90-efe9-4f9a-8a29-dd4d013a7089 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.206620 May 17 15:43:12.819127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 109/210] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:12 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:12.826181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:12.834114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:12.835648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:12.837343 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-10ba060c-a1cb-4b8c-8a5e-ff87118b7d1b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.194017 May 17 15:43:12.837910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 102/211] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:12 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:13.424224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:13.425004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:13.431714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.432166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.432936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.433370 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.463864 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:13.464477 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:13.470402 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.470854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.471623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.472061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.611700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:13.619583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-284d8064-1b52-43f2-b71b-e7071c25394d tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1501 microversion: 2.1 time: 0.199307 May 17 15:43:13.620162 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 110/212] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:13 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:13.633781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:13.641132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-104d2679-e9c6-4bd5-8474-487e4c0de9c2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.181254 May 17 15:43:13.641696 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 103/213] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:13 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:13.841526 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:13.843560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:13.863704 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:13.864375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:13.875243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.876408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.878386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.878821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.879369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.879824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:13.880600 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:13.883435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:14.102746 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:14.111553 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:14.113336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:14.114648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-22292f26-2ca8-4d3a-aa02-c084b6ca5f86 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.259181 May 17 15:43:14.115540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 104/214] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:13 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:14.121197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-84028564-ea65-45fd-b15e-ac8e782815fc req-94872533-7553-47b8-8ea0-661845a2cd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce6ee7f-d1fd-4950-b2b2-6504004d5e01", "name": "network-vif-plugged", "status": "completed", "tag": "83c15363-afe5-4cf3-81f7-17976151a63d"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:14.129223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-84028564-ea65-45fd-b15e-ac8e782815fc req-94872533-7553-47b8-8ea0-661845a2cd16 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:14.129887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-84028564-ea65-45fd-b15e-ac8e782815fc req-94872533-7553-47b8-8ea0-661845a2cd16 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:14.142083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-84028564-ea65-45fd-b15e-ac8e782815fc req-94872533-7553-47b8-8ea0-661845a2cd16 service nova] Creating event network-vif-plugged:83c15363-afe5-4cf3-81f7-17976151a63d for instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 on hv-cinder-84212 May 17 15:43:14.148036 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:14.148577 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-84028564-ea65-45fd-b15e-ac8e782815fc req-94872533-7553-47b8-8ea0-661845a2cd16 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 May 17 15:43:14.150326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 105/215] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:14.159915 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-79fd3829-bedf-4982-80a6-adbe49b19927 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.327714 May 17 15:43:14.162553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 111/216] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:13 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:14.658443 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:14.659134 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:14.665906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:14.666377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:14.667139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:14.667580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:14.791380 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:14.798589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e96b02de-04b9-419e-b231-e8bf93c53e1e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.144403 May 17 15:43:14.799152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 106/217] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:14 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:15.132934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:15.134075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:15.139918 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:15.140373 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:15.141144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:15.141579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:15.177146 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:15.177758 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:15.183607 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:15.184054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:15.184813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:15.185241 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:15.310126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:15.317924 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:15.319465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:15.321065 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-11741f76-c5cc-4e47-b8b8-4b734110ac99 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.191435 May 17 15:43:15.321625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 112/218] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:15 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:15.343306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:15.350493 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0adeb563-d674-486e-801a-1589648c1ff0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.177119 May 17 15:43:15.351045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 107/219] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:15 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:15.814461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:15.815106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:15.821562 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:15.822025 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:15.822809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:15.823248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:15.949451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:15.956773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-82edb14c-b79c-4a25-ba5a-b544b972afa1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.146073 May 17 15:43:15.957522 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 113/220] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:15 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:16.338473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:16.339016 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:16.344942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:16.345388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:16.346193 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:16.346630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:16.366550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:16.367239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:16.373505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:16.374052 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:16.374883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:16.375384 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:16.534069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:16.541453 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:16.542453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:16.543948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:16.545043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1b076745-165b-48f9-8bc8-18a1dc8578ca tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.210486 May 17 15:43:16.545798 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 108/221] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:16 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:16.548849 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0c8032bd-3d69-4505-82c0-0b86d5492458 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.186026 May 17 15:43:16.549399 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 114/222] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:16 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:16.972867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:16.973467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:16.979597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:16.980039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:16.980788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:16.981228 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:17.109067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:17.116366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-da01716f-2e32-4aa2-a457-c0a70df79ac2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.147357 May 17 15:43:17.116929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 109/223] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:16 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:17.563659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:17.564172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:17.565363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:17.565966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:17.570269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:17.570720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:17.571499 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:17.571688 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:17.571933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:17.572140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:17.572903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:17.573340 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:17.755147 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:17.759140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:17.762496 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-37bae21f-ac75-4302-af4c-1e71c8025c73 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.200845 May 17 15:43:17.763058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 110/224] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:17 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:17.767254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:17.768810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:17.769907 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d26cd421-86e7-4210-8c93-aa2a0d70714a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.210248 May 17 15:43:17.770500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 115/225] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:17 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:18.135813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:18.136358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:18.142263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:18.142717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:18.143479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:18.143915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:18.275299 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:18.283349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e4b04d5b-c94f-4c3f-ac17-5d4d451423c6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.151882 May 17 15:43:18.283907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 111/226] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:18 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:18.779067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:18.779649 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:18.785892 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:18.786374 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:18.787148 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:18.787587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:18.787903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:18.788513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:18.794848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:18.795298 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:18.796064 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:18.796492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:19.168337 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:19.171560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:19.177135 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fb93174f-d791-4c09-867a-1f8d1cc98825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.401894 May 17 15:43:19.178112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 116/227] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:18 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:19.180288 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:19.181797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:19.182926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d3a8be37-a0a5-465c-8e39-ed1e0dd21898 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1406 microversion: 2.20 time: 0.398835 May 17 15:43:19.190827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 112/228] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:18 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:43:19.300837 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:19.301463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:19.307889 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:19.308333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:19.309087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:19.309517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:19.441642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:19.452597 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fbd9e631-b0e9-4e1d-b762-0b16654e30d7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.155577 May 17 15:43:19.453233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 117/229] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:19 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:20.195244 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:20.196675 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:20.203288 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:20.203848 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:20.205631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.207237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.208652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.209093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.212435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.212770 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.213754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.214223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.428175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:20.432866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:20.443895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b328dd72-b168-4087-84e0-5fd93ce46f2f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.251455 May 17 15:43:20.445988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:20.447889 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:20.449229 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e8a1949c-0d1a-4c68-80f0-ecc0d3d39739 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1597 microversion: 2.20 time: 0.251650 May 17 15:43:20.454247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 113/230] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:20 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:20.462289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 118/231] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:43:20 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1597 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:43:20.467573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:20.468070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:20.470612 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:20.471140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:20.474307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.474943 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.475733 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.476191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.478528 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.479139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.480067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:20.480675 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:20.676260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ac110c66-6535-45a3-8c5c-3f76e3176db1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.212599 May 17 15:43:20.677028 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 114/232] 10.222.0.75 () {60 vars in 1315 bytes} [Tue May 17 15:43:20 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:43:20.680830 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:20.689896 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b3372d8d-30bc-4a37-8570-9091f5c2b78e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.222872 May 17 15:43:20.691042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 119/233] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:20 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:21.461757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:21.462460 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:21.468474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:21.468929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:21.469700 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:21.470173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:21.671117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:21.678527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b0f593d9-90b0-4667-8769-c2f2a3939113 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.220894 May 17 15:43:21.679175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 115/234] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:21 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:21.707036 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:21.707678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:21.714226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:21.714684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:21.715456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:21.715893 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:22.094054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-0d11bcae-2037-4bdd-aeaa-e26c15c812a4 req-59ae066d-2d6c-4204-a5ec-208cd5b11d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:22.103461 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-0d11bcae-2037-4bdd-aeaa-e26c15c812a4 req-59ae066d-2d6c-4204-a5ec-208cd5b11d27 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:22.104114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-0d11bcae-2037-4bdd-aeaa-e26c15c812a4 req-59ae066d-2d6c-4204-a5ec-208cd5b11d27 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:22.107459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:22.115015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-0d11bcae-2037-4bdd-aeaa-e26c15c812a4 req-59ae066d-2d6c-4204-a5ec-208cd5b11d27 service nova] Creating event network-changed:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:43:22.115177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b2dc8b38-be88-448f-8429-2129f30332eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.411940 May 17 15:43:22.115670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 120/235] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:21 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:22.120298 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-0d11bcae-2037-4bdd-aeaa-e26c15c812a4 req-59ae066d-2d6c-4204-a5ec-208cd5b11d27 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029912 May 17 15:43:22.120873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 116/236] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:43:22.696754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:22.697629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:22.704178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:22.704877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:22.705852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:22.706325 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:22.838450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:22.846289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-08e00c80-50d4-43af-a9e9-84b6cf9acbe0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.154074 May 17 15:43:22.846860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 121/237] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:22 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:23.132257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:23.133503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:23.139710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:23.140183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:23.146167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:23.146621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:23.282230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:23.290789 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6850ce9e-3f00-4d60-9e9a-408c77c555a4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.162672 May 17 15:43:23.291529 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 117/238] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:23 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:23.863045 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:23.863663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:23.869591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:23.870100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:23.870862 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:23.871299 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:23.993869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:24.001084 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fcf958a7-a218-4d0d-8dc2-052cc5ad78a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.141844 May 17 15:43:24.001647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 122/239] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:23 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:24.308442 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:24.309001 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:24.314787 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:24.315235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:24.316003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:24.316437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:24.443099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:24.450396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-25cda6cc-a9e4-48ed-a0e3-99d02f7c9bb3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.146489 May 17 15:43:24.450964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 118/240] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:24 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:25.018056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:25.018665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:25.025263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:25.025770 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:25.026631 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:25.027109 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:25.151043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:25.158357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c05c2996-ee50-47e6-bac6-c59065958d18 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.144287 May 17 15:43:25.158926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 123/241] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:25 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:25.466819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:25.467470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:25.473217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:25.473677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:25.474452 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:25.474884 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:25.580934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-40b3610d-7b1a-46c6-9fbf-c8e2068c4891 req-dc3d9d90-81a0-4e9d-96ea-7dd2a82cb67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e592f5a-3f22-48bd-b517-5ddd4d5c2503", "name": "network-vif-plugged", "status": "completed", "tag": "41b61a96-78fb-4784-84f7-a1553b8a3cee"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:25.591431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-40b3610d-7b1a-46c6-9fbf-c8e2068c4891 req-dc3d9d90-81a0-4e9d-96ea-7dd2a82cb67b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:25.592067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-40b3610d-7b1a-46c6-9fbf-c8e2068c4891 req-dc3d9d90-81a0-4e9d-96ea-7dd2a82cb67b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:25.606244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-40b3610d-7b1a-46c6-9fbf-c8e2068c4891 req-dc3d9d90-81a0-4e9d-96ea-7dd2a82cb67b service nova] Creating event network-vif-plugged:41b61a96-78fb-4784-84f7-a1553b8a3cee for instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 on hv-cinder-84212 May 17 15:43:25.614477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-40b3610d-7b1a-46c6-9fbf-c8e2068c4891 req-dc3d9d90-81a0-4e9d-96ea-7dd2a82cb67b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036941 May 17 15:43:25.615657 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 124/242] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:25.636950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:25.645554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-121685e3-d1da-4b0e-acb8-f5a95412f62f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.182252 May 17 15:43:25.646660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 119/243] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:25 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:26.175280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:26.176137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:26.183767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:26.184156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:26.184929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:26.185365 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:26.320496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:26.327683 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c89223a0-ee16-43f8-86ab-2fb0ec323e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.156542 May 17 15:43:26.328248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 125/244] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:26 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:26.662868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:26.663846 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:26.670485 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:26.671059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:26.671829 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:26.672257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:26.678505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eeac764-2646-4041-90ad-5101ff54f9c6"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:26.679610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:26.685387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:26.685839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:26.686660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:26.687235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:26.796792 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:26.803971 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1e0901af-5214-40ae-ace0-3f9ac553a63d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1322 microversion: 2.1 time: 0.144849 May 17 15:43:26.804537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 120/245] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:26 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:27.344341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:27.344950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:27.352143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:27.352911 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:27.353972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:27.354352 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:27.504070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:27.511400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0cc8a944-d47e-49f8-aaf2-a2530bce3111 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1368 microversion: 2.1 time: 0.170881 May 17 15:43:27.511955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 121/246] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:27 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:27.821175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:27.821868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:27.827904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:27.828355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:27.829256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:27.829692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:27.961426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:27.969777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-003e9aa5-1921-46cf-adb6-695e4aa3d827 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1516 microversion: 2.1 time: 0.152741 May 17 15:43:27.970810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 122/247] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:27 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:27.993274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:27.994273 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:28.000008 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.000451 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.001210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.001641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.023819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'flavor' on Instance uuid 73cc19bf-e9b1-4087-bffb-757df05d29e5 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:43:28.167659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-adf8a04e-d85a-4c6b-9edb-5014949dbbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5/action" status: 200 len: 32 microversion: 2.1 time: 0.178844 May 17 15:43:28.168419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 123/248] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:43:27 2022] POST /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 15:43:28.177767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:28.178603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:28.186919 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.187379 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.188179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.188682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.249772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4435f869-0f80-4871-8c22-4c9a14121abd tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "POST /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.575112 May 17 15:43:28.250740 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 126/249] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:43:26 2022] POST /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937/os-volume_attachments => generated 194 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:43:28.326326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:28.333869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f811db99-cff6-42b6-81bd-9455dc954ced tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.160329 May 17 15:43:28.334681 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 124/250] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:28 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:28.529030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:28.529947 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:28.536465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.537058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.537854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.538275 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.833479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:28.841444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9d0f2b86-fc75-48bb-88a3-686f491bdd37 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1558 microversion: 2.1 time: 0.317924 May 17 15:43:28.842034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 127/251] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:28 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:28.858344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:28.858841 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:28.864640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.865087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.865852 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:28.866310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:28.948699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e4dbecc0-a0d0-4ad0-92ff-40698a2152ca tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093995 May 17 15:43:28.949525 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 125/252] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:43:28 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:29.352233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:29.352786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:29.359259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:29.359734 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:29.369072 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:29.369652 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:29.718197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:29.736919 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7c158dfa-c732-4a6f-9b8c-25d941cc7ca7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.388882 May 17 15:43:29.737817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 128/253] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:29 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:30.434186 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a0bbc159-7252-4bf2-b711-4d3d72719f5e req-56082255-961f-4674-b9ba-31513f6bf5de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce6ee7f-d1fd-4950-b2b2-6504004d5e01", "tag": "83c15363-afe5-4cf3-81f7-17976151a63d"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:30.443521 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a0bbc159-7252-4bf2-b711-4d3d72719f5e req-56082255-961f-4674-b9ba-31513f6bf5de service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:30.444170 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a0bbc159-7252-4bf2-b711-4d3d72719f5e req-56082255-961f-4674-b9ba-31513f6bf5de service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:30.643167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a0bbc159-7252-4bf2-b711-4d3d72719f5e req-56082255-961f-4674-b9ba-31513f6bf5de service nova] Creating event network-changed:83c15363-afe5-4cf3-81f7-17976151a63d for instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 on hv-cinder-84212 May 17 15:43:30.649066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-a0bbc159-7252-4bf2-b711-4d3d72719f5e req-56082255-961f-4674-b9ba-31513f6bf5de service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219820 May 17 15:43:30.650292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 126/254] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:30.755052 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:30.756574 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:30.767407 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:30.767863 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:30.768651 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:30.769081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:31.011348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:31.022910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6c8585ef-2fd4-4820-88dc-b298d4b751d2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.271653 May 17 15:43:31.025977 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 129/255] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:30 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:32.051631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:32.054104 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:32.067875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:32.068679 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:32.069734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:32.071147 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:32.360567 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:32.371558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3217a28e-86ad-412a-b7ca-64cd1094fa59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.330989 May 17 15:43:32.382218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 127/256] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:32 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:33.388798 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:33.407178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:33.414568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:33.415269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:33.416501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:33.417160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:33.616332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:33.624942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b7769441-db35-4206-a188-997f715cb24b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.240051 May 17 15:43:33.625982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 130/257] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:33 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:34.643274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:34.644642 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:34.651263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:34.651714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:34.652476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:34.652906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:34.845881 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:34.853482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7d07c786-457e-4650-9fd0-c08cb1860519 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.214064 May 17 15:43:34.854066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 128/258] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:34 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:35.870104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:35.870741 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:35.877000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:35.877451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:35.878242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:35.878678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:36.009006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:36.016577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-57ceb517-edf0-4f40-8944-b73899b5e2da tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.150247 May 17 15:43:36.017086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 131/259] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:35 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:37.032395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:37.033078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:37.039094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:37.039590 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:37.040376 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:37.040815 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:37.164899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:37.172260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d95dd95c-a86a-4092-8eac-5643bbf27ed2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.143685 May 17 15:43:37.172819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 129/260] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:37 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:38.189316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:38.189962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:38.196532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:38.196987 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:38.197750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:38.198219 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:38.321525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:38.328997 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-981fec92-e837-4505-9aa5-a06fa8eb2d38 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.143527 May 17 15:43:38.329566 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 132/261] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:38 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:39.346518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:39.347067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:39.353723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:39.354197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:39.354958 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:39.355395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:39.501188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:39.509591 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2f08da62-2d32-47ea-b0cb-0b718d46b0a2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.167134 May 17 15:43:39.510271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 130/262] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:39 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:40.526327 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:40.527004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:40.533240 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:40.533694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:40.534498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:40.534938 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:40.661013 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:40.668828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-590b7b2a-1178-418d-97e0-da46a109487f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.146352 May 17 15:43:40.669398 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 133/263] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:40 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:41.686199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:41.686817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:41.692810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:41.693342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:41.694238 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:41.694727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:41.835266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:41.843642 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-573e8071-6719-4ad5-ab00-84f157d2bd59 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.161386 May 17 15:43:41.844211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 131/264] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:41 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:42.234952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:42.234952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:42.241730 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:42.242138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:42.242917 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:42.243348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:42.274019 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:43:42.387612 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-509bddec-629e-497a-b78d-a5bbbb6b14f6 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 204 len: 0 microversion: 2.1 time: 0.157017 May 17 15:43:42.388212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 134/265] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:43:42 2022] DELETE /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:43:42.396818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:42.397435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:42.405056 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:42.405382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:42.406401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:42.406931 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:42.604530 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:42.614041 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-20eaf1bf-f6c8-4fa8-bd87-1203e7d43930 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1553 microversion: 2.1 time: 0.221463 May 17 15:43:42.614702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 132/266] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:42 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:42.861269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:42.862341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:42.870880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:42.871333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:42.872122 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:42.872740 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:43.049165 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:43.059558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-35bea15f-9708-43fb-a842-7565c8f63e6e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.202632 May 17 15:43:43.060792 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 135/267] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:42 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:43.631152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:43.631846 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:43.639093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:43.639633 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:43.640484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:43.641002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:43.784363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:43.793035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-57d04342-65cf-4d4b-be5e-43e8075820c8 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1553 microversion: 2.1 time: 0.165595 May 17 15:43:43.794437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 133/268] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:43 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:44.078629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:44.079267 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:44.085281 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:44.085918 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:44.086748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:44.087410 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:44.431767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:44.439400 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-649341e0-3ac7-4880-bb7d-1ec44f2241eb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.365062 May 17 15:43:44.439968 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 136/269] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:44 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:44.814276 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:44.815565 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:44.823095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:44.823547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:44.827102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:44.829172 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:45.074554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:45.098604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8ff51759-d2f6-4070-bf6a-de6d551e256a tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1553 microversion: 2.1 time: 0.288208 May 17 15:43:45.099914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 134/270] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:44 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:45.456732 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:45.458921 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:45.468753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:45.469540 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:45.470600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:45.471332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:45.809077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:45.817628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-588561c1-c553-4911-a174-64d78ae8d3a0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.364736 May 17 15:43:45.818221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 137/271] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:45 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:46.119446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:46.120215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:46.131293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:46.132493 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:46.133984 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:46.136023 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:46.264512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-f403967a-d840-4d81-8548-28ed047bfab5 req-0dfde95b-b38d-41ff-921e-41882404cf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7797a3e2-eeb5-44a3-8026-daa018079937", "name": "network-vif-deleted", "tag": "64187337-3bb7-410e-8b83-1eed22758592"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:46.276328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:46.292991 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-f403967a-d840-4d81-8548-28ed047bfab5 req-0dfde95b-b38d-41ff-921e-41882404cf82 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:46.294151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f59651bc-c9c4-486e-8f75-a568574ddb9b tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1511 microversion: 2.1 time: 0.178702 May 17 15:43:46.295112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-f403967a-d840-4d81-8548-28ed047bfab5 req-0dfde95b-b38d-41ff-921e-41882404cf82 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:46.297181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 135/272] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:46 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:46.318647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-f403967a-d840-4d81-8548-28ed047bfab5 req-0dfde95b-b38d-41ff-921e-41882404cf82 service nova] Creating event network-vif-deleted:64187337-3bb7-410e-8b83-1eed22758592 for instance 7797a3e2-eeb5-44a3-8026-daa018079937 on hv-cinder-84212 May 17 15:43:46.323500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-f403967a-d840-4d81-8548-28ed047bfab5 req-0dfde95b-b38d-41ff-921e-41882404cf82 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069018 May 17 15:43:46.324176 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 138/273] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:46.833643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:46.834218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:46.840926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:46.841374 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:46.842464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:46.842901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:46.991918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:46.999573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-29d138de-6cb7-47f6-917c-1878ce471cad tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.169720 May 17 15:43:47.000147 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 136/274] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:46 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:47.315213 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:47.315213 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:47.323405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:47.324036 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:47.324992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:47.325525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:47.402639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df32bb55daa64c5396bd96a86f19b5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e120255943e4fecadc7d4a2a9188f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:47.422883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b013e675-e336-4b89-91a4-d1f5ad440c19 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 200 len: 1346 microversion: 2.1 time: 0.112395 May 17 15:43:47.423509 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 139/275] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:47 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 1346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:48.016736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:48.017480 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:48.028658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:48.028658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:48.028658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:48.028658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:48.180403 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:48.188384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-522301ea-718e-4404-83d5-ec9000a93dc5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.175336 May 17 15:43:48.188927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 137/276] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:48 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:48.439912 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:48.440588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:48.449612 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:48.450115 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:48.450950 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:48.451342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:48.466483 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] HTTP exception thrown: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Request method failure captured: May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 HTTP/1.1 May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JBoM0JtbO-7_L08nFEDL8hz-kt8AWdT3wAt0KfjrMqsNw8KpUPCNw3JohJL2d5fxgTME6ZHcUgy09zWlFRStikTsTaN9pnTloxxmg_bkk6ihVy6NTEN4r8qP1AxeadGEzOQ2P8TxhVjcWLAtaDhjw5uwbcZQSsVK_An3-NNSde09Y May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:43:48.472616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5e120255943e4fecadc7d4a2a9188f9d"}]}] May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: df32bb55daa64c5396bd96a86f19b5d8 May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.473839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '7797a3e2-eeb5-44a3-8026-daa018079937'} May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:43:48.474558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.475725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:48.477865 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Returning 404 to user: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:43:48.478998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-19af85d4-cafa-4b32-aac2-c9026a9cc2ad tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 404 len: 111 microversion: 2.1 time: 0.042934 May 17 15:43:48.479543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 140/277] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:48 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:43:48.594556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:48.595679 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:48.603439 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:48.603885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:48.607699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:48.607699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:48.618628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] HTTP exception thrown: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Request method failure captured: May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937/os-volume_attachments HTTP/1.1 May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JBoM0JtbO-7_L08nFEDL8hz-kt8AWdT3wAt0KfjrMqsNw8KpUPCNw3JohJL2d5fxgTME6ZHcUgy09zWlFRStikTsTaN9pnTloxxmg_bkk6ihVy6NTEN4r8qP1AxeadGEzOQ2P8TxhVjcWLAtaDhjw5uwbcZQSsVK_An3-NNSde09Y May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:43:48.623527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5e120255943e4fecadc7d4a2a9188f9d"}]}] May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: df32bb55daa64c5396bd96a86f19b5d8 May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.624774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'server_id': '7797a3e2-eeb5-44a3-8026-daa018079937'} May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:43:48.625419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:48.626853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:48.628262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Returning 404 to user: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:43:48.628262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-79e6ca74-9f04-4b53-8082-1e66255c9498 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036664 May 17 15:43:48.628262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 138/278] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:43:48 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:43:49.206127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:49.207064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:49.213321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:49.213908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:49.214826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:49.215324 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:49.368529 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:49.376762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c82d17d7-ef22-4883-8337-5aaf0f06fe8f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.174748 May 17 15:43:49.377536 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 141/279] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:49 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:49.839835 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:49.841787 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:49.849882 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:49.850654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:49.851557 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:49.852514 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:49.874745 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] HTTP exception thrown: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Request method failure captured: May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 HTTP/1.1 May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JBoM0JtbO-7_L08nFEDL8hz-kt8AWdT3wAt0KfjrMqsNw8KpUPCNw3JohJL2d5fxgTME6ZHcUgy09zWlFRStikTsTaN9pnTloxxmg_bkk6ihVy6NTEN4r8qP1AxeadGEzOQ2P8TxhVjcWLAtaDhjw5uwbcZQSsVK_An3-NNSde09Y May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:43:49.877117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5e120255943e4fecadc7d4a2a9188f9d"}]}] May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: df32bb55daa64c5396bd96a86f19b5d8 May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.878617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '7797a3e2-eeb5-44a3-8026-daa018079937'} May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:43:49.879421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.880740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:43:49.883721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Returning 404 to user: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:43:49.884728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d09b1822-f682-4c90-96fa-94b4404ab85e tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "DELETE /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 404 len: 111 microversion: 2.1 time: 0.050361 May 17 15:43:49.885468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 139/280] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:43:49 2022] DELETE /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:43:49.895264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:49.895948 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] [instance: 7797a3e2-eeb5-44a3-8026-daa018079937] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:49.902583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:49.903726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:49.904522 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:49.905077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:49.920497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] HTTP exception thrown: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Request method failure captured: May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 HTTP/1.1 May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JBoM0JtbO-7_L08nFEDL8hz-kt8AWdT3wAt0KfjrMqsNw8KpUPCNw3JohJL2d5fxgTME6ZHcUgy09zWlFRStikTsTaN9pnTloxxmg_bkk6ihVy6NTEN4r8qP1AxeadGEzOQ2P8TxhVjcWLAtaDhjw5uwbcZQSsVK_An3-NNSde09Y May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:43:49.922137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5e120255943e4fecadc7d4a2a9188f9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5e120255943e4fecadc7d4a2a9188f9d"}]}] May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 5e120255943e4fecadc7d4a2a9188f9d May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-DeleteServersTestJSON-1855511581 May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: df32bb55daa64c5396bd96a86f19b5d8 May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-DeleteServersTestJSON-1855511581-project May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.923543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '7797a3e2-eeb5-44a3-8026-daa018079937'} May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:43:49.924348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. May 17 15:43:49.925579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:43:49.928254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] Returning 404 to user: Instance 7797a3e2-eeb5-44a3-8026-daa018079937 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:43:49.929686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-917ea48d-ddb6-4014-aeae-c99108fdc057 tempest-DeleteServersTestJSON-1855511581 tempest-DeleteServersTestJSON-1855511581-project] 10.222.0.75 "GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937" status: 404 len: 111 microversion: 2.1 time: 0.038730 May 17 15:43:49.930310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 142/281] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:49 2022] GET /compute/v2.1/servers/7797a3e2-eeb5-44a3-8026-daa018079937 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:43:50.396660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:50.397604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:50.406734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:50.406830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:50.408063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:50.408573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:50.870089 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:50.882081 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9c55bee7-c911-48b0-8729-b47e8e02a3ef tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.490564 May 17 15:43:50.882899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 140/282] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:50 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:51.899765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:51.901009 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:51.909041 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:51.909865 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:51.910882 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:51.911566 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:52.104020 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:52.114184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-16f42339-da55-4989-a59d-b22d204d0b3d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.218558 May 17 15:43:52.115403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 143/283] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:51 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:53.134893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:53.135732 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:53.142803 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:53.143333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:53.144225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:53.144780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:53.315863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:53.342688 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e2d3b12a-9268-4f2b-9598-a8190de7e6e6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.213931 May 17 15:43:53.343338 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 141/284] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:53 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:54.360746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:54.361410 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:54.374750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:54.375655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:54.378739 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:54.379759 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:54.596640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:54.605067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a95b7ef6-7cfd-40b2-8b6f-59ea8f623bb4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.248194 May 17 15:43:54.605632 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 144/285] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:54 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:54.873960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-12842a32-0829-494b-9d70-e05eb9606b6c tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f764ff70>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:54.958804 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-12842a32-0829-494b-9d70-e05eb9606b6c tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9b09409c-ffe3-4396-9cd1-e60297fb63dc" status: 200 len: 351 microversion: 2.1 time: 0.088861 May 17 15:43:54.959378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 142/286] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:43:54 2022] GET /compute/v2.1/os-volumes/9b09409c-ffe3-4396-9cd1-e60297fb63dc => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:55.622968 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:55.624004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:55.633011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:55.633485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:55.634269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:55.634711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:55.764785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:55.772544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ce75f388-1280-4dd7-86eb-91d72797f1b4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.153359 May 17 15:43:55.773190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 145/287] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:55 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:56.324600 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4e95cb73-71f9-47b2-b254-4dd920128c8d tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83fd564e50>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:56.371260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4e95cb73-71f9-47b2-b254-4dd920128c8d tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/f3047f91-0dfb-415b-a2f2-d711a30e99cd" status: 200 len: 351 microversion: 2.1 time: 0.050671 May 17 15:43:56.371910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 143/288] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:43:56 2022] GET /compute/v2.1/os-volumes/f3047f91-0dfb-415b-a2f2-d711a30e99cd => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:56.791492 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:56.792038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:56.798478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:56.798973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:56.799753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:56.800198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:56.929254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:56.936648 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6dbaf50f-cbba-4aef-9168-03755322840e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.149737 May 17 15:43:56.937221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 146/289] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:56 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:57.952803 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:57.953386 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:57.960856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:57.961378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:57.962212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:57.962678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:58.067818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-463361983", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "networks": [{"uuid": "4c8b2043-78bf-4e27-83d8-b2eb9952990b"}]}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:43:58.091378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:58.099535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f76f6d97-ab75-4c1d-a9c9-4243138decf6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.150751 May 17 15:43:58.100115 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 144/290] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:57 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:58.125129 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] validate_networks() for [('4c8b2043-78bf-4e27-83d8-b2eb9952990b', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:43:58.473964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:43:58.474436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:43:58.474914 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:43:58.475847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:43:58.476296 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:43:58.485187 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:58.485586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:58.486444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:58.486891 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:58.503618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Getting quotas for project cac36e5078db4023a88b7720e409780b. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:43:58.507548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Getting quotas for user 8f0f8ee6e0d24c749a405850ba15f560 and project cac36e5078db4023a88b7720e409780b. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:43:58.518531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:43:58.520755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:43:58.565303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1e25d462-2b71-48cc-9e54-6865f6924899 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501388 May 17 15:43:58.565943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 147/291] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 15:43:58.575533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3048c2d0-d2af-49d5-a746-3848ab3dd13d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:58.576137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3048c2d0-d2af-49d5-a746-3848ab3dd13d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:58.627447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3048c2d0-d2af-49d5-a746-3848ab3dd13d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:58.634103 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3048c2d0-d2af-49d5-a746-3848ab3dd13d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1213 microversion: 2.1 time: 0.062113 May 17 15:43:58.634704 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 145/292] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:58 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:58.725307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8c5defb5-b5aa-4570-9599-f3c92898a8f4 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f7587940>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:58.772523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8c5defb5-b5aa-4570-9599-f3c92898a8f4 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/3e62dff1-e5b6-4dca-83f8-de9e518ce1e5" status: 200 len: 351 microversion: 2.1 time: 0.050959 May 17 15:43:58.773188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 148/293] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:43:58 2022] GET /compute/v2.1/os-volumes/3e62dff1-e5b6-4dca-83f8-de9e518ce1e5 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:58.785812 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6d6dd2a2-69d6-4fe1-8cde-f8893792793f tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f75c04c0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:58.865962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6d6dd2a2-69d6-4fe1-8cde-f8893792793f tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084627 May 17 15:43:58.866586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 146/294] 10.222.0.75 () {58 vars in 1133 bytes} [Tue May 17 15:43:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:58.879191 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-23f85b04-4472-402f-8456-ae2fbccc5934 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f757f0d0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:58.965202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-23f85b04-4472-402f-8456-ae2fbccc5934 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089761 May 17 15:43:58.965856 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 149/295] 10.222.0.75 () {58 vars in 1148 bytes} [Tue May 17 15:43:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:58.978415 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1891324a-3ad7-427c-8001-cef4bc4a259c tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f75c0dc0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.061926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1891324a-3ad7-427c-8001-cef4bc4a259c tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087617 May 17 15:43:59.062601 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 147/296] 10.222.0.75 () {58 vars in 1133 bytes} [Tue May 17 15:43:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:59.074244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e8152f72-b501-4a8b-aa36-6f9a0378d3a7 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f757f820>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.117062 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.117890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:59.124383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:59.124917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:59.125787 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:59.126354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:59.168349 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e8152f72-b501-4a8b-aa36-6f9a0378d3a7 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097733 May 17 15:43:59.168919 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 150/297] 10.222.0.75 () {58 vars in 1166 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:59.181186 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2a16a9a9-529d-4089-a1bc-daa01f7d7676 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f758a4c0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.262140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2a16a9a9-529d-4089-a1bc-daa01f7d7676 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085400 May 17 15:43:59.262918 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 151/298] 10.222.0.75 () {58 vars in 1169 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:43:59.268359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:59.274483 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8e21f208-1fbb-4f4f-ad52-e35f059a799a tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f758a8b0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.276317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-253a4720-8f67-4a0b-8acf-722fc0cf7c31 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.163651 May 17 15:43:59.276960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 148/299] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:59.353577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8e21f208-1fbb-4f4f-ad52-e35f059a799a tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082705 May 17 15:43:59.354206 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 152/300] 10.222.0.75 () {58 vars in 1154 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:43:59.365096 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ffa48868-804f-4d4e-ba1e-69333847d74a tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f7630430>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.445559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ffa48868-804f-4d4e-ba1e-69333847d74a tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083701 May 17 15:43:59.446765 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 149/301] 10.222.0.75 () {58 vars in 1187 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:43:59.461060 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2123a09c-12e9-4dac-8875-e543ca73c395 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] Calling method '.version_select at 0x7f83f758a430>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.546130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2123a09c-12e9-4dac-8875-e543ca73c395 tempest-VolumesTestJSON-37333919 tempest-VolumesTestJSON-37333919-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088758 May 17 15:43:59.546699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 153/302] 10.222.0.75 () {58 vars in 1154 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:43:59.651606 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:43:59.652676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:43:59.666157 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:59.666728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:59.667791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:43:59.668319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:43:59.789415 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:43:59.797305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f6a0bba2-2799-4117-a15f-ba6165d05c3b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1283 microversion: 2.1 time: 0.150262 May 17 15:43:59.797880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 150/303] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:43:59 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1283 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:00.293300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:00.293915 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:00.300711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:00.301154 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:00.301962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:00.302416 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:00.568310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:00.576382 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3b576265-2d38-4aee-b0b3-be44769ff504 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.287550 May 17 15:44:00.577054 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 154/304] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:00 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:00.813988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:00.814770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:00.820678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:00.821122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:00.821891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:00.822378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:01.059884 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:01.067135 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9a386bbf-4fc5-4cd7-8187-5c7874c9512d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.257007 May 17 15:44:01.067709 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 151/305] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:00 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:01.474295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-09133973-ba68-4a54-8539-3cd06421e3a5 req-89a2826b-dbfc-484c-a84f-53632f9cda93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ea6195-a881-4528-ba3a-1759e848a742", "tag": "416fca4c-7448-4df1-9d51-65f335cec4e9"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:01.487525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-09133973-ba68-4a54-8539-3cd06421e3a5 req-89a2826b-dbfc-484c-a84f-53632f9cda93 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:01.487966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-09133973-ba68-4a54-8539-3cd06421e3a5 req-89a2826b-dbfc-484c-a84f-53632f9cda93 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:01.499780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-09133973-ba68-4a54-8539-3cd06421e3a5 req-89a2826b-dbfc-484c-a84f-53632f9cda93 service nova] Creating event network-changed:416fca4c-7448-4df1-9d51-65f335cec4e9 for instance d1ea6195-a881-4528-ba3a-1759e848a742 on hv-cinder-84212 May 17 15:44:01.504617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-09133973-ba68-4a54-8539-3cd06421e3a5 req-89a2826b-dbfc-484c-a84f-53632f9cda93 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034472 May 17 15:44:01.505201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 155/306] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:44:01.592517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:01.593131 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:01.599049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:01.599499 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:01.600783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:01.601399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:01.805005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:01.812365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-85477486-f1f6-4518-b6b7-5f0356f4becb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.223649 May 17 15:44:01.812922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 152/307] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:01 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:02.085257 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:02.085908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:02.092414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:02.092625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:02.093389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:02.093824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:02.223758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:02.231917 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0a0c4d97-ae9c-421f-8c43-24a6c7d5d41d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.151671 May 17 15:44:02.232490 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 156/308] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:02 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:02.828658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:02.829198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:02.835325 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:02.835776 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:02.836544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:02.836982 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:02.964667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:02.972345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4221a84e-c490-4efe-86d9-0a2a54adc223 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.147567 May 17 15:44:02.972901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 153/309] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:02 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:03.248857 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:03.249590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:03.256147 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:03.256727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:03.257509 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:03.257951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:03.432259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:03.440235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-00877c9d-32d8-4d6e-b3aa-4e274fb5efb1 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.195353 May 17 15:44:03.440797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 157/310] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:03 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:03.990149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:03.991465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:03.997285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:03.997816 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:03.998850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:03.999276 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:04.126863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:04.134029 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-edbbcf5f-714d-4cf7-aa81-fa94bccc112a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.147991 May 17 15:44:04.134595 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 154/311] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:03 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:04.456524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:04.457260 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:04.464273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:04.464725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:04.465490 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:04.465929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:04.600784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:04.608242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-51da4d7b-3c69-42fc-b084-ca254ae11c6b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.155520 May 17 15:44:04.608809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 158/312] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:04 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:05.151048 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:05.151653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:05.157701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:05.158202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:05.159000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:05.159439 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:05.290433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:05.297673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cef7aeb0-dd84-4c51-9c76-bddf3570024b tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.151001 May 17 15:44:05.298264 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 155/313] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:05 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:05.624791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:05.625412 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:05.632329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:05.632776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:05.633579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:05.634029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:05.779952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:05.787899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-68b81cd1-3e9c-462f-b032-133fd762b77d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.166930 May 17 15:44:05.795453 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 159/314] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:05 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:06.315498 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:06.316176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:06.322036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:06.322504 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:06.323284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:06.323724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:06.453802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:06.461817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2bb974d6-65a1-4a87-87ed-f76b1a46ce49 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.150219 May 17 15:44:06.462451 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 156/315] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:06 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:06.805419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:06.806049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:06.813367 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:06.813813 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:06.814613 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:06.815046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:06.944849 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:06.952461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1ca6a295-1f95-4772-882b-fc7e756dceb5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.151497 May 17 15:44:06.953034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 160/316] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:06 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:07.479399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:07.480087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:07.486593 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:07.487240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:07.488189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:07.488949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:07.724688 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:07.732862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-75324f2d-ec26-4964-8abf-cb2d4e9146cd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.258140 May 17 15:44:07.733515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 157/317] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:07 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:07.969300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:07.969907 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:07.976300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:07.976747 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:07.977765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:07.978220 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:08.121499 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:08.132343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8dfd6161-37b6-4b83-a776-d5ad557bd972 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.166390 May 17 15:44:08.133163 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 161/318] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:07 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:08.234645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-98836345-6805-4762-88dd-eaf557396ecc req-dc12adb9-a2df-43ea-a9cf-a7e11bd4de7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ea6195-a881-4528-ba3a-1759e848a742", "name": "network-vif-plugged", "status": "completed", "tag": "416fca4c-7448-4df1-9d51-65f335cec4e9"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:08.245292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-98836345-6805-4762-88dd-eaf557396ecc req-dc12adb9-a2df-43ea-a9cf-a7e11bd4de7b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:08.246041 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-98836345-6805-4762-88dd-eaf557396ecc req-dc12adb9-a2df-43ea-a9cf-a7e11bd4de7b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:08.262313 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-98836345-6805-4762-88dd-eaf557396ecc req-dc12adb9-a2df-43ea-a9cf-a7e11bd4de7b service nova] Creating event network-vif-plugged:416fca4c-7448-4df1-9d51-65f335cec4e9 for instance d1ea6195-a881-4528-ba3a-1759e848a742 on hv-cinder-84212 May 17 15:44:08.268847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-98836345-6805-4762-88dd-eaf557396ecc req-dc12adb9-a2df-43ea-a9cf-a7e11bd4de7b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038249 May 17 15:44:08.269531 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 158/319] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:44:08.749738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:08.750336 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:08.756360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:08.756816 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:08.757590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:08.758067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:08.888212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:08.895832 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-22c00172-e577-4162-9146-85d376cfc899 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.149977 May 17 15:44:08.896401 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 162/320] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:08 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:09.149866 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:09.150649 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:09.157589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:09.158070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:09.158851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:09.159288 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:09.290335 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:09.297953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d75153ff-0c84-4b1b-a58d-f7fd597a5a25 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.152325 May 17 15:44:09.298607 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 159/321] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:09 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:09.913774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:09.914346 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:09.920600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:09.921044 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:09.921810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:09.922264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:10.057047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:10.064345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c95b44eb-5692-4fab-b674-4a988acd1290 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.154557 May 17 15:44:10.064997 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 163/322] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:09 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:10.315914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:10.316445 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:10.323474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:10.323925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:10.324697 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:10.325137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:10.452831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:10.460978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-00985318-3cf2-4997-b402-e58e57baa2d6 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1313 microversion: 2.1 time: 0.148978 May 17 15:44:10.461558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 160/323] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:10 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:11.081466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:11.082127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:11.088509 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:11.089068 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:11.089896 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:11.090405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:11.223633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:11.232451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-baa692b7-332b-468a-b9bc-c3ebd6d702cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.154808 May 17 15:44:11.233017 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 164/324] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:11 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:11.483446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:11.485322 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:11.494087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:11.495293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:11.495578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:11.496271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:11.628772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:11.636276 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3337e09b-db8f-4c11-862f-5afc53e21e4d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1496 microversion: 2.1 time: 0.162531 May 17 15:44:11.636848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 161/325] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:11 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1496 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:12.252329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:12.252947 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:12.259403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:12.259858 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:12.260641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:12.261081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:12.400757 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:12.408125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3f2becc0-e7d3-4b8b-8461-34d832dcab20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.159594 May 17 15:44:12.408696 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 165/326] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:12 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:12.878947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:12.879449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:12.885700 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:12.886181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:12.886938 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:12.887364 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:12.913235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:44:13.010401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-19252ef9-9d30-4f8e-8452-17a2d435839c tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 204 len: 0 microversion: 2.1 time: 0.134862 May 17 15:44:13.011292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 162/327] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:44:12 2022] DELETE /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:44:13.019100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:13.019715 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:13.026338 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:13.026908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:13.027689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:13.028160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:13.156557 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:13.164200 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d9e76ffb-544a-4647-a330-2dbb4204e932 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.148877 May 17 15:44:13.164831 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 166/328] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:13 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:13.425103 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:13.425796 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:13.433227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:13.433674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:13.434469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:13.434893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:13.581446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:13.589304 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9e0913e7-b13c-4cde-aea4-083509d3a656 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.168384 May 17 15:44:13.599309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 163/329] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:13 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:14.181223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:14.181840 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:14.188455 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:14.188902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:14.189670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:14.190137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:14.316120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:14.323463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-00f4df7b-e616-4a9d-85fd-801442bf4be4 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.146615 May 17 15:44:14.324039 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 167/330] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:14 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:14.616977 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:14.617589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:14.623686 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:14.624075 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:14.624844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:14.625280 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:14.758493 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:14.766834 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f2464ac8-6421-4f75-a722-22da92b54ce9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.153989 May 17 15:44:14.767568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 164/331] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:14 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:15.341171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:15.341796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:15.348293 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:15.348753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:15.349524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:15.350632 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:15.481668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:15.488960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-de14a539-17ad-4f1f-9069-440122d16844 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.151623 May 17 15:44:15.489521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 168/332] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:15 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:15.783509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:15.784114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:15.790447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:15.790900 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:15.791667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:15.792107 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:15.920111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:15.927472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-55402c67-2b8a-405a-b867-a2aa3674ddd3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.147790 May 17 15:44:15.928035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 165/333] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:15 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:16.506070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:16.506624 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:16.513011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:16.513461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:16.514253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:16.514689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:16.645224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:16.652710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3f75bb10-15b3-414a-8a79-ccf7d13cc3f3 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.150586 May 17 15:44:16.653283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 169/334] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:16 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:16.944688 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:16.945296 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:16.951228 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:16.951675 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:16.952434 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:16.952865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:17.076068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:17.083386 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b36934a3-5dca-4696-ad5b-8cfac6ad7775 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.143126 May 17 15:44:17.083899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 166/335] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:16 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:17.669579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:17.670365 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:17.676701 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:17.677149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:17.677967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:17.678430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:17.809985 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:17.817419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3908b487-68f6-4557-92ca-74dd71e5985a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.151713 May 17 15:44:17.817974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 170/336] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:17 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:18.100714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:18.102432 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:18.108809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:18.109344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:18.110165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:18.110599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:18.252744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:18.260567 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3605aa57-1dd5-411a-bd62-e5a7d3cb4fe6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.164062 May 17 15:44:18.261125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 167/337] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:18 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:18.833634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:18.834569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:18.840984 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:18.841438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:18.842237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:18.842673 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:18.970973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:18.978993 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7c61f505-4467-4864-a625-7d192b76ec7b tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.149193 May 17 15:44:18.979553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 171/338] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:18 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:19.277640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:19.278283 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:19.284251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:19.284701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:19.285468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:19.285904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:19.413833 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:19.421086 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b86f6fa2-79fb-408f-b66f-3532fbfe7108 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.147272 May 17 15:44:19.421656 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 168/339] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:19 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:19.996354 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:19.996964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:20.003377 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:20.003820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:20.004595 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:20.005024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:20.135267 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:20.142739 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c0ecc5cc-e52a-4cdf-bd75-cbe8c1b8250a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1502 microversion: 2.1 time: 0.150086 May 17 15:44:20.143321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 172/340] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:19 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:20.437854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:20.439472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:20.445425 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:20.445876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:20.447156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:20.447668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:20.660118 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:20.668678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c522328e-5e56-48be-b44d-23845a60c75f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.234856 May 17 15:44:20.669249 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 169/341] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:20 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:20.958381 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-d1e7129b-842f-47f2-ac94-3638ac3d1b74 req-488d482e-fe14-4f66-8d08-5895503bc7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ea6195-a881-4528-ba3a-1759e848a742", "name": "network-vif-deleted", "tag": "416fca4c-7448-4df1-9d51-65f335cec4e9"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:20.969689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-d1e7129b-842f-47f2-ac94-3638ac3d1b74 req-488d482e-fe14-4f66-8d08-5895503bc7b0 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:20.970283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-d1e7129b-842f-47f2-ac94-3638ac3d1b74 req-488d482e-fe14-4f66-8d08-5895503bc7b0 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:20.984650 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-d1e7129b-842f-47f2-ac94-3638ac3d1b74 req-488d482e-fe14-4f66-8d08-5895503bc7b0 service nova] Creating event network-vif-deleted:416fca4c-7448-4df1-9d51-65f335cec4e9 for instance d1ea6195-a881-4528-ba3a-1759e848a742 on hv-cinder-84212 May 17 15:44:20.989777 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-d1e7129b-842f-47f2-ac94-3638ac3d1b74 req-488d482e-fe14-4f66-8d08-5895503bc7b0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035845 May 17 15:44:20.990934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 173/342] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:44:21.158878 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:21.159512 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:21.166023 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:21.166473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:21.167237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:21.167676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:21.200234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:21.200678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:21.201125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lazy-loading 'fault' on Instance uuid d1ea6195-a881-4528-ba3a-1759e848a742 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:44:21.246734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:21.253952 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-12b9f960-7092-4835-a8b3-7cddf6a904be tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1303 microversion: 2.1 time: 0.098954 May 17 15:44:21.254534 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 170/343] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:21 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:21.685696 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:21.686417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:21.692730 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:21.693197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:21.694581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:21.695029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:21.830030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:21.837379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-434ba1c0-5789-4079-ac81-20df3e8bc896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.156316 May 17 15:44:21.837941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 174/344] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:21 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:22.272346 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:22.272953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:22.280527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:22.280527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:22.280527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:22.280839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:22.312308 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:22.312742 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:22.313195 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lazy-loading 'fault' on Instance uuid d1ea6195-a881-4528-ba3a-1759e848a742 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:44:22.353619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:22.361015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d00e5aa4-a36e-465c-a2dd-48d11ae4278f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1303 microversion: 2.1 time: 0.093772 May 17 15:44:22.361578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 171/345] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:22 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:22.855202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:22.855820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:22.865970 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:22.865970 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:22.865970 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:22.865970 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:22.997961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:23.005589 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f46fb907-55f9-47bc-af91-63a88cf00c54 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.154448 May 17 15:44:23.006500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 175/346] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:22 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:23.377864 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:23.378513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:23.385539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:23.386016 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:23.386826 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:23.387266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:23.428940 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:23.429381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:23.429988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lazy-loading 'fault' on Instance uuid d1ea6195-a881-4528-ba3a-1759e848a742 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:44:23.474552 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:23.483363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f64eb861-510a-4ce5-97e9-f4217b634cbf tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 200 len: 1303 microversion: 2.1 time: 0.109374 May 17 15:44:23.484267 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 172/347] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:23 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:24.023112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:24.023725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:24.030068 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:24.030531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:24.031303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:24.031746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:24.174850 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:24.184116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-724ad535-ad8b-47e7-80f4-edfaa4b35bed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.165210 May 17 15:44:24.184686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 176/348] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:24 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:24.500544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:24.501145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d1ea6195-a881-4528-ba3a-1759e848a742] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:24.506978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:24.507427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:24.508198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:24.508629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:24.523036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] HTTP exception thrown: Instance d1ea6195-a881-4528-ba3a-1759e848a742 could not be found. May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Request method failure captured: May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 HTTP/1.1 May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8K7NYyIqRRphSmrv2AKr45ZxZ5AIyBKhWP6AaH_YWjab9WEDH9gI1lQKb2xL0FKpB8VbLG181NizIwdFq8q8goJALxJYMO2zKQECgzuvo4hC4vh9NFL6BO9SpLzg7qkyt-iFc6A1jsMZet6ygo2xAETyd3AlPfFVkcoXbdgmm1Sijk May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: cac36e5078db4023a88b7720e409780b May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesActionsTest-1372161787 May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:44:24.524671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cac36e5078db4023a88b7720e409780b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cac36e5078db4023a88b7720e409780b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cac36e5078db4023a88b7720e409780b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cac36e5078db4023a88b7720e409780b"}]}] May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesActionsTest-1372161787 May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: cac36e5078db4023a88b7720e409780b May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesActionsTest-1372161787 May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesActionsTest-1372161787-project May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 8f0f8ee6e0d24c749a405850ba15f560 May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesActionsTest-1372161787-project May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance d1ea6195-a881-4528-ba3a-1759e848a742 could not be found. May 17 15:44:24.526122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'd1ea6195-a881-4528-ba3a-1759e848a742'} May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ea6195-a881-4528-ba3a-1759e848a742 could not be found. May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:44:24.527500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ea6195-a881-4528-ba3a-1759e848a742 could not be found. May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ea6195-a881-4528-ba3a-1759e848a742 could not be found. May 17 15:44:24.528891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:24.530125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Returning 404 to user: Instance d1ea6195-a881-4528-ba3a-1759e848a742 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:44:24.530125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ef25884b-cc50-44ed-92c8-ce8d50d82936 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742" status: 404 len: 111 microversion: 2.1 time: 0.029341 May 17 15:44:24.530125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 173/349] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:24 2022] GET /compute/v2.1/servers/d1ea6195-a881-4528-ba3a-1759e848a742 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:44:24.623869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-620195344", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "networks": [{"uuid": "4c8b2043-78bf-4e27-83d8-b2eb9952990b"}]}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:24.673844 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] validate_networks() for [('4c8b2043-78bf-4e27-83d8-b2eb9952990b', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:44:25.027242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:44:25.027811 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:44:25.028128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:44:25.028530 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:44:25.028941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:44:25.039501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:25.039967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:25.040775 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:25.041227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:25.061332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Getting quotas for project cac36e5078db4023a88b7720e409780b. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:44:25.065283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Getting quotas for user 8f0f8ee6e0d24c749a405850ba15f560 and project cac36e5078db4023a88b7720e409780b. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:44:25.077957 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:44:25.080273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:44:25.127628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8d85c8e8-9cb6-4253-b2c5-0cf26dcd6694 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508156 May 17 15:44:25.128598 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 177/350] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:44:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:44:25.139239 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0f273b88-4eb0-4a7f-a0cf-9421432a9d46 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:25.140218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0f273b88-4eb0-4a7f-a0cf-9421432a9d46 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:25.202357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:25.203260 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:25.210744 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:25.211438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:25.212380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:25.213003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0f273b88-4eb0-4a7f-a0cf-9421432a9d46 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:25.213763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:25.219780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0f273b88-4eb0-4a7f-a0cf-9421432a9d46 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1213 microversion: 2.1 time: 0.084934 May 17 15:44:25.220619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 174/351] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:25 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:25.349785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:25.357431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8fcd0ed1-317e-437f-9d7d-4321e46f19ba tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1522 microversion: 2.1 time: 0.159623 May 17 15:44:25.358019 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 178/352] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:25 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:26.236556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:26.237165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:26.244831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:26.245520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:26.247144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:26.247850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:26.331660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:26.340124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-17fef70a-fad0-49bb-a7f1-67e4f849a067 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1265 microversion: 2.1 time: 0.107306 May 17 15:44:26.350385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 175/353] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:26 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:26.375370 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:26.377500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:26.393535 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:26.394292 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:26.395841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:26.397282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:26.621603 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:26.629380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-63a20f54-c541-4b36-a106-18d3ae3c1569 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1502 microversion: 2.1 time: 0.258589 May 17 15:44:26.630565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 179/354] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:26 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1502 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:26.646772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:26.647988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:26.655774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:26.656382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:26.657336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:26.657918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:26.892654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:26.900740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b2cbc0f9-e245-4aa5-951a-76afffdb56f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1516 microversion: 2.1 time: 0.258519 May 17 15:44:26.901660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 176/355] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:26 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:27.356779 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:27.357595 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:27.364091 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:27.364490 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:27.366100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:27.366728 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:27.579716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:27.590528 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-33e2fa44-5e63-42f2-a98f-87974fe4e5dc tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.236894 May 17 15:44:27.591707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 180/356] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:27 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:28.071271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-81411b1c-4378-408e-a082-44c0879b1d94 req-7f114ea2-5571-44c1-9cde-b5d766be6f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69e1674-3a2a-40e5-a83a-7ffa026ba8bc", "tag": "b911982c-5ae7-4f08-b215-54873ba67242"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:28.096872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-81411b1c-4378-408e-a082-44c0879b1d94 req-7f114ea2-5571-44c1-9cde-b5d766be6f2f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:28.097324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-81411b1c-4378-408e-a082-44c0879b1d94 req-7f114ea2-5571-44c1-9cde-b5d766be6f2f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:28.111822 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-81411b1c-4378-408e-a082-44c0879b1d94 req-7f114ea2-5571-44c1-9cde-b5d766be6f2f service nova] Creating event network-changed:b911982c-5ae7-4f08-b215-54873ba67242 for instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc on hv-cinder-84212 May 17 15:44:28.117463 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-81411b1c-4378-408e-a082-44c0879b1d94 req-7f114ea2-5571-44c1-9cde-b5d766be6f2f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053462 May 17 15:44:28.118643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 177/357] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:44:28.608722 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:28.609339 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:28.616539 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:28.616995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:28.617815 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:28.618393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:28.747634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:28.755275 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5e63aa68-19a9-40c6-a40c-80d9be7db5b0 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.150388 May 17 15:44:28.756456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 181/358] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:28 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:29.336575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:29.337765 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:29.344402 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:29.344858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:29.345630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:29.346094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:29.368004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'flavor' on Instance uuid 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:44:29.439105 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-32f55d24-e877-4bf4-b72c-fbf71a51d3de tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/action" status: 200 len: 32 microversion: 2.1 time: 0.107536 May 17 15:44:29.439707 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 178/359] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:44:29 2022] POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/action => generated 32 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:44:29.449237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:29.449853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:29.456260 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:29.456726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:29.457496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:29.457935 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:29.586952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:29.594254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7dd4e235-b42e-40b5-9364-e33422419e5c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.148836 May 17 15:44:29.594826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 182/360] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:29 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:29.773176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:29.773894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:29.780081 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:29.780535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:29.781299 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:29.781771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:29.910854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:29.918144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-84ffa739-4312-4926-b15d-4108887132ae tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.149272 May 17 15:44:29.918716 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 179/361] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:29 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:30.083946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1312365623", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:30.132532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] validate_networks() for None {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:44:30.611706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:30.612328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:30.619124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:30.619581 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:30.620370 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:30.620808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:30.648348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:44:30.648800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:44:30.649269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:44:30.649708 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:44:30.650194 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:44:30.659046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:30.659498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:30.660333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:30.660767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:30.677287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Getting quotas for project 29ff5f34a5094ef9a5c8c4b5b924415b. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:44:30.681517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Getting quotas for user b860a94349204b7d86ad796882dcd402 and project 29ff5f34a5094ef9a5c8c4b5b924415b. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:44:30.692227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:44:30.695018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:44:30.738853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7e50d960-64b4-4b90-af93-14e6998506e9 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658634 May 17 15:44:30.744717 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 183/362] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:44:30.749797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bf1872d4-39f2-4426-abf4-5d3218de0c02 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:30.750550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bf1872d4-39f2-4426-abf4-5d3218de0c02 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:30.756854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:30.765621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3f246fed-6e62-4fe9-8182-89f446e4e749 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.157641 May 17 15:44:30.767452 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 180/363] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:30 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:30.809302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bf1872d4-39f2-4426-abf4-5d3218de0c02 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:30.816089 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bf1872d4-39f2-4426-abf4-5d3218de0c02 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1215 microversion: 2.1 time: 0.070042 May 17 15:44:30.816719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 184/364] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:30 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:30.943855 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:30.944501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:30.951449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:30.951904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:30.952693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:30.953136 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:31.085895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:31.093233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-070bfb46-2421-4a95-a1db-8b02e613372d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.154014 May 17 15:44:31.093786 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 181/365] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:30 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:31.784506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:31.785042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:31.792008 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:31.792461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:31.793239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:31.793684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:31.835566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:31.836179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:31.842134 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:31.842587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:31.843358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:31.843792 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:31.916256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:31.923505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c7ecaf44-5291-4028-a1c4-5d52ca24c080 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1219 microversion: 2.1 time: 0.092263 May 17 15:44:31.924077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 182/366] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:31 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:31.944532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:31.952888 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-96e2916c-249f-4456-9be9-78369a477804 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.172308 May 17 15:44:31.953464 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 185/367] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:31 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:32.111066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:32.111676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:32.118202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:32.118685 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:32.119439 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:32.119872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:32.246902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:32.254355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5a73a339-7de5-46bd-ac36-ad4a52d13ef5 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.147137 May 17 15:44:32.254999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 183/368] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:32 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:32.940368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:32.940905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:32.948063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:32.948512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:32.949277 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:32.949715 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:32.971548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:32.972157 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:32.979377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:32.979822 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:32.980642 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:32.981102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:33.012533 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:33.020030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8a5e0608-ed81-4103-88d4-70bb77677677 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1267 microversion: 2.1 time: 0.083574 May 17 15:44:33.020692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 186/369] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:32 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:33.111486 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:33.119452 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5e137fa8-3161-4229-ac4c-3873fc7a783e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.151892 May 17 15:44:33.120624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 184/370] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:32 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:33.272946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:33.273471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:33.281073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:33.281537 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:33.283145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:33.283145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:33.608913 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:33.617110 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6b511c4d-b5f5-44a2-8ee7-5e12f1a8ca2f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.348755 May 17 15:44:33.617712 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 187/371] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:33 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:34.037187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:34.037828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:34.044092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.044616 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.045464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.045976 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.136611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:34.138764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:34.139506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:34.144506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8a7c7d02-afa2-4d6f-ac44-4f3fd2d0cec0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1273 microversion: 2.1 time: 0.111063 May 17 15:44:34.145329 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 185/372] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:34 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:34.151445 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.152011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.152909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.154082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.477239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:34.488555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bef4a4d6-db82-4d81-813a-69c0a19c16c1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.354295 May 17 15:44:34.489610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 188/373] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:34 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:34.517544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-c0834bac-3575-454e-a352-94a0b8cccc52 req-13fe7812-c457-4828-8be6-9faa0b91b498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69e1674-3a2a-40e5-a83a-7ffa026ba8bc", "name": "network-vif-plugged", "status": "completed", "tag": "b911982c-5ae7-4f08-b215-54873ba67242"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:34.526156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-c0834bac-3575-454e-a352-94a0b8cccc52 req-13fe7812-c457-4828-8be6-9faa0b91b498 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.526850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-c0834bac-3575-454e-a352-94a0b8cccc52 req-13fe7812-c457-4828-8be6-9faa0b91b498 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.539618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-c0834bac-3575-454e-a352-94a0b8cccc52 req-13fe7812-c457-4828-8be6-9faa0b91b498 service nova] Creating event network-vif-plugged:b911982c-5ae7-4f08-b215-54873ba67242 for instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc on hv-cinder-84212 May 17 15:44:34.544641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-c0834bac-3575-454e-a352-94a0b8cccc52 req-13fe7812-c457-4828-8be6-9faa0b91b498 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030923 May 17 15:44:34.545540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 186/374] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:44:34.634235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:34.634778 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:34.641856 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.642341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.643117 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:34.643559 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:34.871937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:34.879137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-284078dc-1a77-4a47-983d-b94e093a4078 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.249457 May 17 15:44:34.879709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 189/375] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:34 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:35.161292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:35.162130 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:35.168383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:35.168835 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:35.169595 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:35.170057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:35.301858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:35.309769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9148a113-55a8-4d7d-8fae-aa0ef8808f72 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.152827 May 17 15:44:35.310371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 187/376] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:35 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:35.507438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:35.507982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:35.514422 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:35.514910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:35.515689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:35.516133 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:35.687325 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:35.694768 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2a57286d-75e7-417e-864e-650073150712 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.191333 May 17 15:44:35.695352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 190/377] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:35 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:35.897039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:35.897763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:35.903699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:35.904143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:35.904906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:35.905337 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:36.104683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:36.114388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6bd713cf-1abc-4334-b514-5e5ec074a07a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.221432 May 17 15:44:36.122472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 188/378] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:35 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:36.312989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-b4dceb86-6735-4d3a-9d8e-87b490945b38 req-c89c032f-c955-44a9-bd55-07fca6d17f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290d1a3d-abf8-4e35-91e7-836323f7c29a", "tag": "91a2f875-0d76-427a-bce2-b1eaae2030e7"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:36.321419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b4dceb86-6735-4d3a-9d8e-87b490945b38 req-c89c032f-c955-44a9-bd55-07fca6d17f5f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:36.322420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b4dceb86-6735-4d3a-9d8e-87b490945b38 req-c89c032f-c955-44a9-bd55-07fca6d17f5f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:36.326541 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:36.327703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:36.334256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:36.334900 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:36.335867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:36.336203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-b4dceb86-6735-4d3a-9d8e-87b490945b38 req-c89c032f-c955-44a9-bd55-07fca6d17f5f service nova] Creating event network-changed:91a2f875-0d76-427a-bce2-b1eaae2030e7 for instance 290d1a3d-abf8-4e35-91e7-836323f7c29a on hv-cinder-84212 May 17 15:44:36.336323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:36.342487 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-b4dceb86-6735-4d3a-9d8e-87b490945b38 req-c89c032f-c955-44a9-bd55-07fca6d17f5f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038064 May 17 15:44:36.343099 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 191/379] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:44:36.510225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:36.517610 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a6d97500-7a7c-4673-90c6-76c30e32248b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.194949 May 17 15:44:36.518342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 189/380] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:36 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:36.712592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:36.713289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:36.724126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:36.724126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:36.724126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:36.724126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:36.886773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:36.894068 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5c2c1266-b3e2-4600-bb01-f51abecc29b0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.186516 May 17 15:44:36.894639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 192/381] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:36 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:37.131707 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:37.132350 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:37.138660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:37.139108 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:37.139913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:37.140353 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:37.266635 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:37.274131 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-fc4f6f9c-fd46-4447-8567-67ccec0c8cd2 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1313 microversion: 2.1 time: 0.146871 May 17 15:44:37.274701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 190/382] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:37 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:37.534415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:37.535051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:37.541784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:37.542264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:37.543047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:37.543479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:37.912693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:37.913575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:37.920594 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:37.921352 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:37.922453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:37.922892 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:37.937281 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:37.945516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-08d65cec-25c8-4bb4-94a3-4dff7dc0ecef tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.414907 May 17 15:44:37.946462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 193/383] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:37 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:38.054986 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:38.062174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4e714a1f-9e87-45e4-9600-dff1bb68b798 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.153868 May 17 15:44:38.062732 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 191/384] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:37 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:38.290192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:38.290737 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:38.296783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:38.297230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:38.298026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:38.298463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:38.429333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:38.436608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4ab12f0e-731d-4a09-9d96-786230735342 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1497 microversion: 2.1 time: 0.150377 May 17 15:44:38.437175 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 194/385] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:38 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:38.872718 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:38.873214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:38.879099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:38.879565 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:38.880922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:38.881360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:38.907618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:44:38.963706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:38.964936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:38.971304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:38.971750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:38.973070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:38.973070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:38.993224 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2c7d22b3-ae50-4368-9946-c32767e66804 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 204 len: 0 microversion: 2.1 time: 0.123940 May 17 15:44:38.993914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 192/386] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:44:38 2022] DELETE /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:44:39.002142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:39.002839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:39.011294 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:39.011734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:39.012513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:39.013206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:39.139983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:39.149010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-46b375a7-3d48-45d5-874a-bdcf1e66961b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.190439 May 17 15:44:39.149592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 195/387] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:38 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:39.154128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:39.154731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:39.160505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:39.160955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:39.162307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:39.162750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:39.180393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:39.187820 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a6528c76-f84b-4d9c-a312-96194cbe0e1d tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1503 microversion: 2.1 time: 0.189653 May 17 15:44:39.188463 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 193/388] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:38 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:39.288403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:39.300215 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-db893a2e-bfac-4e22-8c9c-6d4e967925e5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.149606 May 17 15:44:39.300793 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 196/389] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:39 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:40.164636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:40.165275 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:40.171326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:40.171764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:40.172522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:40.172960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:40.204572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:40.205213 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:40.211634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:40.212085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:40.212862 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:40.213298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:40.343791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:40.351204 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ad90ee89-c3fc-48f4-8dd2-4861c50196f0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.190410 May 17 15:44:40.351780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 194/390] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:40 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:40.356543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:40.357181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:40.365743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:40.366302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:40.367159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:40.367605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:40.378495 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:40.386555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3c0335bb-c79f-4700-9013-65a332424647 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1503 microversion: 2.1 time: 0.185844 May 17 15:44:40.387135 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 197/391] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:40 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:40.504163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:40.511909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-57d9899a-af23-4aad-b5b5-0a8e6607b965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.158925 May 17 15:44:40.512466 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 195/392] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:40 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:41.368868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:41.369508 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:41.376666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:41.377059 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:41.377840 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:41.378316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:41.403248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:41.403935 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:41.420426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:41.420881 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:41.421667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:41.422153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:41.559867 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:41.567220 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-11aca374-8579-4f4a-8bc8-04be52e9cbf5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.202936 May 17 15:44:41.567797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 198/393] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:41 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:41.572202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:41.572811 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:41.578523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:41.578982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:41.579752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:41.580196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:41.586804 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:41.594204 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-652321be-d4f7-4120-a3ea-4b71ec49545f tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1503 microversion: 2.1 time: 0.195028 May 17 15:44:41.594771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 196/394] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:41 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:41.722103 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:41.730235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b0cd5966-2778-407a-a910-b19d0d7767c7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.161468 May 17 15:44:41.730802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 199/395] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:41 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:42.584298 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:42.584902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:42.591201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:42.591880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:42.593360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:42.593805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:42.611744 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:42.612332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:42.618783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:42.619226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:42.619974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:42.620408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:42.878145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:42.881684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:42.887209 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-da3e4b17-9fad-4b09-9ecc-341155adc261 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1503 microversion: 2.1 time: 0.279267 May 17 15:44:42.889200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6dd4a42b-c0a2-4a8f-8fe6-8887e3f2a8e4 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.309170 May 17 15:44:42.889840 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 197/396] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:42 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:42.894418 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:42.895076 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:42.897665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 200/397] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:42 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:42.901569 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:42.902022 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:42.902800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:42.903226 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:43.042444 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:43.050679 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-38302567-8401-45c4-b27f-114782059659 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.159648 May 17 15:44:43.051259 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 198/398] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:42 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:43.907411 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:43.908075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:43.908437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:43.908563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:43.915173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:43.915762 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:43.916870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:43.917087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:43.917453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:43.917565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:43.918318 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:43.918752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:44.148280 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:44.152487 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:44.155999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3533735a-829a-4b47-b6dc-164c530696fb tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.253678 May 17 15:44:44.156580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 199/399] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:43 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:44.160239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0033dd65-959b-46a4-9e78-ed020f0b5471 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1503 microversion: 2.1 time: 0.259059 May 17 15:44:44.160806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 201/400] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:43 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:44.161308 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:44.162638 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:44.168414 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:44.168972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:44.169731 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:44.170195 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:44.301144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:44.308282 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-75baffd7-4c8b-4f64-a00d-300985ad3918 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.150634 May 17 15:44:44.308844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 200/401] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:44 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:44.599376 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-b4e33abe-a4ce-4b6c-8cc7-281750d05837 req-9a03fd0e-ef6e-4b5e-8fc7-7c5008a71e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d1a3d-abf8-4e35-91e7-836323f7c29a", "name": "network-vif-plugged", "status": "completed", "tag": "91a2f875-0d76-427a-bce2-b1eaae2030e7"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:44.607548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b4e33abe-a4ce-4b6c-8cc7-281750d05837 req-9a03fd0e-ef6e-4b5e-8fc7-7c5008a71e62 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:44.608186 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b4e33abe-a4ce-4b6c-8cc7-281750d05837 req-9a03fd0e-ef6e-4b5e-8fc7-7c5008a71e62 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:44.619769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-b4e33abe-a4ce-4b6c-8cc7-281750d05837 req-9a03fd0e-ef6e-4b5e-8fc7-7c5008a71e62 service nova] Creating event network-vif-plugged:91a2f875-0d76-427a-bce2-b1eaae2030e7 for instance 290d1a3d-abf8-4e35-91e7-836323f7c29a on hv-cinder-84212 May 17 15:44:44.624507 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-b4e33abe-a4ce-4b6c-8cc7-281750d05837 req-9a03fd0e-ef6e-4b5e-8fc7-7c5008a71e62 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028925 May 17 15:44:44.625094 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 202/402] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:44:45.173396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:45.174090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:45.181193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:45.181193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:45.185773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:45.186267 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:45.187049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:45.187493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:45.188286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:45.188737 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:45.189509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:45.189940 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:45.395572 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:45.398756 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:45.403090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1c35e84b-08e8-4056-bb5b-ff4c45199e05 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.233454 May 17 15:44:45.403804 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 201/403] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:45 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:45.406379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e5fdb28f-0104-4db3-bc08-71352bb74987 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1503 microversion: 2.1 time: 0.233207 May 17 15:44:45.407394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 203/404] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:45 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:45.418327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:45.418953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:45.425005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:45.425839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:45.426656 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:45.427264 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:45.562551 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:45.570411 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-135357d4-0035-4d6b-9399-7e75d168e66d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.165451 May 17 15:44:45.570990 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 202/405] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:45 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:46.378950 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-20b4146a-1a85-4874-8d93-f1641a3073c1 req-442c3604-81b6-4ca8-b7c6-ed79b75d8357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69e1674-3a2a-40e5-a83a-7ffa026ba8bc", "name": "network-vif-deleted", "tag": "b911982c-5ae7-4f08-b215-54873ba67242"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:46.387208 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-20b4146a-1a85-4874-8d93-f1641a3073c1 req-442c3604-81b6-4ca8-b7c6-ed79b75d8357 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.387650 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-20b4146a-1a85-4874-8d93-f1641a3073c1 req-442c3604-81b6-4ca8-b7c6-ed79b75d8357 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.398695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-20b4146a-1a85-4874-8d93-f1641a3073c1 req-442c3604-81b6-4ca8-b7c6-ed79b75d8357 service nova] Creating event network-vif-deleted:b911982c-5ae7-4f08-b215-54873ba67242 for instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc on hv-cinder-84212 May 17 15:44:46.403320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-20b4146a-1a85-4874-8d93-f1641a3073c1 req-442c3604-81b6-4ca8-b7c6-ed79b75d8357 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027979 May 17 15:44:46.403890 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 204/406] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:44:46.421285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:46.421894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:46.423810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:46.424511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:46.427842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.428323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.434232 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.434232 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.434460 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.434460 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.434460 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.434460 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.524003 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:46.531504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0bbdcb6e-8e27-4f12-8334-26748451ea62 tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1461 microversion: 2.1 time: 0.111599 May 17 15:44:46.532080 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 205/407] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:46 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:46.586540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:46.588583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:46.589243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:46.594221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5a3f5057-bffb-4873-b40b-0e966550ed7c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.177591 May 17 15:44:46.594791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 203/408] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:46 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:46.595403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.595859 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.596646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:46.597086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:46.728596 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:46.736103 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c74f8398-698b-4f4a-9ecd-b5447b34974a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.152554 May 17 15:44:46.736869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 206/409] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:46 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:47.548412 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:47.549054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:47.554863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.555310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.556075 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.556508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.588487 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.588936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.589388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lazy-loading 'fault' on Instance uuid d69e1674-3a2a-40e5-a83a-7ffa026ba8bc {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:44:47.611190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:47.611750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:47.618828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.619276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.620048 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.620894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.632343 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:47.640837 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e24f0f49-7dec-4fcb-9a35-7404e423802a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1303 microversion: 2.1 time: 0.096158 May 17 15:44:47.641631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 204/410] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:47 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:47.753059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:47.753768 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:47.760192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:47.760320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.760759 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.761524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:47.761959 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:47.771710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-66bd7dc3-55b8-4986-a7f9-59119270fd7a tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1315 microversion: 2.1 time: 0.164502 May 17 15:44:47.772990 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 207/411] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:47 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:47.903129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:47.910631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6185839e-9996-4a31-bee2-77a210759dcb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.161444 May 17 15:44:47.911202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 205/412] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:47 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:48.658080 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:48.658700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:48.665190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.665644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.666444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.666884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.698146 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.698523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.698987 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lazy-loading 'fault' on Instance uuid d69e1674-3a2a-40e5-a83a-7ffa026ba8bc {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:44:48.746673 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f8ee6e0d24c749a405850ba15f560', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac36e5078db4023a88b7720e409780b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:48.754120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-de397832-5cf7-4674-8fa5-07871bbcda1a tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 200 len: 1303 microversion: 2.1 time: 0.099893 May 17 15:44:48.754926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 208/413] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:48 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:48.789188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:48.789806 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:48.795830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.796344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.797545 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.797988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.928127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:48.928745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:48.933375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:48.934614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.935070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.935857 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.936301 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.941290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c1a0137a-76e5-4c2a-b20f-506a6502405f tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1465 microversion: 2.1 time: 0.156606 May 17 15:44:48.941883 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 206/414] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:48 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:48.980823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:48.981320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:48.987112 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.987564 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:48.988327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:48.988760 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.013587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:44:49.065350 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:49.073181 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4e74954a-f3d4-41f7-b40f-63826eebadbc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1502 microversion: 2.1 time: 0.149466 May 17 15:44:49.073762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 209/415] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:48 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:49.089028 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1a25ed03-de4d-4991-97a9-4be6610fe244 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "DELETE /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 204 len: 0 microversion: 2.1 time: 0.111991 May 17 15:44:49.089591 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 207/416] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:44:48 2022] DELETE /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 15:44:49.090510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f909141f-f849-43b3-9ded-142d6d4507b0"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:49.091635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:49.097634 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:49.097829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.098316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.098442 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:49.099641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.100074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.104715 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.105157 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.105949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.106396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.122808 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] HTTP exception thrown: Cannot 'attach_volume' instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 while it is in vm_state rescued May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Request method failure captured: May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/os-volume_attachments HTTP/1.1 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 74 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JLQwW9F_iSrYfsCSJcOyPs6IDUbEVekJsZBZzSip5wVBdO0j7saQv47K7fwvjQSCAfcSJEBbJlBoWtJ1z7eRDag5jZnAgLohF_IEC6l9EDycghetO2wwQyuvcubo5CbCdJ3XvER5o6CMPuZvZ9FIclMk_5_eFR2-IzClgfM_RUI_8 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:44:49.124711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/87cc0cd3d0df4dccbc28058b6866d076"}]}] May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: b40c7b11fff443fa8c78e8647703e230 May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {"volumeAttachment": {"volumeId": "f909141f-f849-43b3-9ded-142d6d4507b0"}} May 17 15:44:49.126254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Cannot 'attach_volume' instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 while it is in vm_state rescued May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'server_id': '1e592f5a-3f22-48bd-b517-5ddd4d5c2503', 'body': {'volumeAttachment': {'volumeId': 'f909141f-f849-43b3-9ded-142d6d4507b0'}}} May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:44:49.127073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 while it is in vm_state rescued May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:44:49.128196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 while it is in vm_state rescued May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Returning 409 to user: Cannot 'attach_volume' instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 while it is in vm_state rescued {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-51a4fabc-fc97-427e-a583-bd94ca4573f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039820 May 17 15:44:49.129250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 210/417] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:44:49 2022] POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 17 15:44:49.134971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:44:49.135499 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:49.142048 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.142559 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.143481 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.143955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.213100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9191059b-05cd-4d59-80cb-ec8fc60375d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/action" status: 202 len: 0 microversion: 2.1 time: 0.081375 May 17 15:44:49.213806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 211/418] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:44:49 2022] POST /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:44:49.221958 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:49.222699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:49.233485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.234810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.236038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.236498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.255370 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:49.266239 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4a67cc96-34ab-4b61-9053-712870e284f5 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.172287 May 17 15:44:49.267015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 208/419] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:49 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:49.384664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:49.392211 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c837a55b-a2c9-4cc7-a71a-46f7c1763c4e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.174276 May 17 15:44:49.392785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 212/420] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:49 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:49.771184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:49.771726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] [instance: d69e1674-3a2a-40e5-a83a-7ffa026ba8bc] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:49.777575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.778046 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.778820 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:49.779257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:49.792836 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] HTTP exception thrown: Instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc could not be found. May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Request method failure captured: May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc HTTP/1.1 May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8K7NYyIqRRphSmrv2AKr45ZxZ5AIyBKhWP6AaH_YWjab9WEDH9gI1lQKb2xL0FKpB8VbLG181NizIwdFq8q8goJALxJYMO2zKQECgzuvo4hC4vh9NFL6BO9SpLzg7qkyt-iFc6A1jsMZet6ygo2xAETyd3AlPfFVkcoXbdgmm1Sijk May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: cac36e5078db4023a88b7720e409780b May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesActionsTest-1372161787 May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:44:49.794474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cac36e5078db4023a88b7720e409780b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_cac36e5078db4023a88b7720e409780b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/cac36e5078db4023a88b7720e409780b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/cac36e5078db4023a88b7720e409780b"}]}] May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesActionsTest-1372161787 May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: cac36e5078db4023a88b7720e409780b May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesActionsTest-1372161787 May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesActionsTest-1372161787-project May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 8f0f8ee6e0d24c749a405850ba15f560 May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesActionsTest-1372161787-project May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc could not be found. May 17 15:44:49.795928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'd69e1674-3a2a-40e5-a83a-7ffa026ba8bc'} May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc could not be found. May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:44:49.796672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc could not be found. May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc could not be found. May 17 15:44:49.798078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:44:49.799627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] Returning 404 to user: Instance d69e1674-3a2a-40e5-a83a-7ffa026ba8bc could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:44:49.799627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1ab14863-2eb3-4846-be24-3b93d3b87dea tempest-VolumesActionsTest-1372161787 tempest-VolumesActionsTest-1372161787-project] 10.222.0.75 "GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc" status: 404 len: 111 microversion: 2.1 time: 0.028796 May 17 15:44:49.799627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 209/421] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:49 2022] GET /compute/v2.1/servers/d69e1674-3a2a-40e5-a83a-7ffa026ba8bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:44:50.283532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:50.284139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:50.290994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:50.291439 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:50.292210 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:50.292643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:50.410489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:50.410715 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:50.417590 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:50.418173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:50.420401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:50.420926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:50.427756 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:50.436321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dd63e8a4-fb9c-4c78-895d-5e62ba0de346 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.156412 May 17 15:44:50.437089 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 213/422] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:50 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:50.566387 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:50.573713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3ea6170a-761e-41d0-9e28-c9acfc9cfda0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.167556 May 17 15:44:50.574288 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 210/423] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:50 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:51.453670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:51.454244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:51.461113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:51.461596 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:51.462392 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:51.462832 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:51.591169 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:51.591748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:51.591874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:51.597704 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:51.598206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:51.599065 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:51.599185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-655a4908-ef35-441c-9db2-f102bff200a0 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.149440 May 17 15:44:51.599505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:51.599680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 214/424] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:51 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:51.728482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:51.735724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-40e525bb-bb25-42ba-b956-a2ce6e0a324d tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.148333 May 17 15:44:51.736296 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 211/425] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:51 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:52.615897 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:52.616512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:52.622764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:52.623215 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:52.623978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:52.624411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:52.748532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:52.752410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:52.753023 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:52.756364 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f78a1970-9b00-4388-baee-b22d76eb60ff tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.144197 May 17 15:44:52.756936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 215/426] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:52 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:52.759377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:52.759830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:52.760593 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:52.761027 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:52.884331 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:52.891500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1b216719-eccc-4cfc-b884-baceba768d64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.142821 May 17 15:44:52.892094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 212/427] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:52 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:53.773188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:53.773804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:53.780219 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:53.780705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:53.781510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:53.781949 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:53.908834 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:53.909441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:53.914436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:53.917014 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:53.917497 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:53.918375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:53.918817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:53.922307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5f532b71-6ca1-4078-8986-85c9c5bf855b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.153149 May 17 15:44:53.922884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 216/428] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:53 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:54.048716 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:54.057464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-72120c9b-cf80-4b08-b02d-3b196c85dc61 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.152543 May 17 15:44:54.058060 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 213/429] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:53 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:54.939824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:54.940345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:54.947331 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:54.947783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:54.948548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:54.948986 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:55.074752 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:55.076102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:55.077437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:55.082180 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:55.082703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:55.084205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:55.084664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:55.085558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3d9396eb-585f-4005-8e9a-0ce8653796f1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.149668 May 17 15:44:55.086154 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 217/430] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:54 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:55.208407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:55.215555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-60d13abf-6e2c-4000-b632-b5529535e22a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.144724 May 17 15:44:55.216122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 214/431] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:55 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:56.104316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:56.104921 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:56.111280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:56.111731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:56.112505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:56.112941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:56.232674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:56.233907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:56.238645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:56.239852 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:56.240297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:56.241063 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:56.241493 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:56.246048 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-122ae3d3-2faf-4a47-bfb1-f1b51e321b47 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.145884 May 17 15:44:56.246618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 218/432] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:56 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:56.367200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:56.374622 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-98ede5fb-580a-4d83-8d14-6057c2bf9639 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.145834 May 17 15:44:56.375184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 215/433] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:56 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:57.262835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:57.263446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:57.269380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:57.269823 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:57.270608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:57.271087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:57.392101 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:57.392751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:57.394930 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:57.399407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:57.399801 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:57.400568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:57.400999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:57.402639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-19ffe28f-601b-40a0-821e-f55b39bff549 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.143775 May 17 15:44:57.403519 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 219/434] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:57 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:57.534183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:57.542031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-038893f0-e0a0-4ee9-9a9d-a232255834b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.153815 May 17 15:44:57.542589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 216/435] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:57 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:58.420117 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:58.420722 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:58.427551 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:58.428001 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:58.428786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:58.429192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:58.554758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:58.559110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:58.559725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:58.562022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-affb54af-0aac-44f9-9610-c261f5097f7d tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.145743 May 17 15:44:58.562605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 220/436] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:58 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:44:58.565763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:58.566244 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:58.567014 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:58.567441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:58.694210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:58.701491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ace763e9-38e2-4907-8d82-677e4e769af2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.146185 May 17 15:44:58.702077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 217/437] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:58 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:44:59.582114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:59.583228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:59.589470 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:59.589919 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:59.590726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:59.591167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:59.719055 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:44:59.719666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:44:59.726798 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:59.728049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:59.729049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:44:59.729832 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:44:59.957305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:44:59.965378 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e26fad08-4191-4d1b-8710-7f013b37e0cc tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1471 microversion: 2.1 time: 0.387087 May 17 15:44:59.965946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 221/438] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:59 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:00.056308 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:00.063717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a8c6af05-cb18-4648-94ec-722e84d959c9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.348534 May 17 15:45:00.064288 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 218/439] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:44:59 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:00.488904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-4db0cd55-e4b5-4fb7-a52f-2179d5b6dfbf req-47b3002c-01fa-4f87-8fc9-6d43b2c4e20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d1a3d-abf8-4e35-91e7-836323f7c29a", "name": "network-vif-deleted", "tag": "91a2f875-0d76-427a-bce2-b1eaae2030e7"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:00.497096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-4db0cd55-e4b5-4fb7-a52f-2179d5b6dfbf req-47b3002c-01fa-4f87-8fc9-6d43b2c4e20d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:00.497541 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-4db0cd55-e4b5-4fb7-a52f-2179d5b6dfbf req-47b3002c-01fa-4f87-8fc9-6d43b2c4e20d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:00.509052 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-4db0cd55-e4b5-4fb7-a52f-2179d5b6dfbf req-47b3002c-01fa-4f87-8fc9-6d43b2c4e20d service nova] Creating event network-vif-deleted:91a2f875-0d76-427a-bce2-b1eaae2030e7 for instance 290d1a3d-abf8-4e35-91e7-836323f7c29a on hv-cinder-84212 May 17 15:45:00.514131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-4db0cd55-e4b5-4fb7-a52f-2179d5b6dfbf req-47b3002c-01fa-4f87-8fc9-6d43b2c4e20d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028828 May 17 15:45:00.514745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 222/440] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:45:00.984049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:00.984667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:00.991661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:00.992146 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:00.992943 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:00.993447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:01.055605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:01.062790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f7bdc34f-5b45-4c4c-a6bb-ca97ffac3292 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1429 microversion: 2.1 time: 0.082979 May 17 15:45:01.063349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 219/441] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:00 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1429 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:01.081346 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:01.082074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:01.088617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:01.089070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:01.089839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:01.090308 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:01.217399 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:01.225439 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c4ce890b-1f8a-4a04-93c3-6f7318acabed tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.148640 May 17 15:45:01.226022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 223/442] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:01 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:02.079414 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:02.079951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:02.085848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:02.086321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:02.087075 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:02.087506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:02.146802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:02.154036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5b2066e0-2bb3-4019-a45a-7431f54fc67b tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1429 microversion: 2.1 time: 0.078472 May 17 15:45:02.154596 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 220/443] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:02 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:02.242833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:02.243443 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:02.249734 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:02.250223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:02.250982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:02.251416 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:02.375204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:02.382438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-77cbde09-5816-4188-af59-ae8272dc32af tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.144114 May 17 15:45:02.383000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 224/444] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:02 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:03.170897 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:03.171510 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:03.177988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:03.178458 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:03.179215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:03.179645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:03.242220 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:03.249692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-819cc6ab-d2a9-490d-a067-16f0128881ee tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1429 microversion: 2.1 time: 0.082535 May 17 15:45:03.250286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 221/445] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:03 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:03.399821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:03.400446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:03.407747 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:03.409119 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:03.410305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:03.411397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:03.536623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:03.544265 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0a17b5d3-9388-4ac5-8739-3e4f87e1cf78 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.149250 May 17 15:45:03.544839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 225/446] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:03 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:04.268421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:04.269032 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:04.275031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:04.275472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:04.276235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:04.276672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:04.337124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:04.344410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6a05b2b0-da32-4fd8-a6de-ee904638b04c tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1429 microversion: 2.1 time: 0.079833 May 17 15:45:04.344962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 222/447] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:04 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:04.561058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:04.561680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:04.568342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:04.568816 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:04.569641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:04.570141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:04.702868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:04.710235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1c9cc3ae-9b9f-46bc-8304-e92f7fd9ca99 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.153369 May 17 15:45:04.710803 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 226/448] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:04 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:05.361398 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:05.362028 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:05.368059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:05.368513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:05.369284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:05.369717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:05.429348 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:05.436711 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b6a2939b-77fd-4ab4-bfca-c9cb64d757d1 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1429 microversion: 2.1 time: 0.079182 May 17 15:45:05.437271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 223/449] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:05 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:05.728312 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:05.728909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:05.735532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:05.736006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:05.736862 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:05.737324 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:05.864029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:05.871743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4b0c895b-cd9f-4e8f-b639-0e85a9765896 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.148409 May 17 15:45:05.872316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 227/450] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:05 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:06.455133 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:06.456390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:06.463728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:06.464448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:06.466052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:06.466485 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:06.564162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:06.581955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6cf8cb35-279b-4f15-8dfb-853786fdc08e tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1429 microversion: 2.1 time: 0.131473 May 17 15:45:06.597363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 224/451] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:06 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1429 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:06.889482 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:06.890147 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:06.897220 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:06.897711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:06.898620 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:06.899089 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:07.043070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:07.051917 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0f75a60f-ac95-49ae-a310-efbbce8805dc tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.165732 May 17 15:45:07.052778 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 228/452] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:06 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:07.600582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:07.602630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:07.609941 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:07.610531 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:07.611515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:07.612182 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:07.643828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:07.644370 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:07.644952 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lazy-loading 'fault' on Instance uuid 290d1a3d-abf8-4e35-91e7-836323f7c29a {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:45:07.688702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:07.697732 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-fe43517d-dd81-49db-bdf1-21e17ff6c2ac tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1305 microversion: 2.1 time: 0.101529 May 17 15:45:07.701017 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 225/453] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:07 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:08.078994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:08.080462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:08.087677 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:08.088133 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:08.088936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:08.089545 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:08.244834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:08.252776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f20b775a-3f2b-48e1-ab6a-a83ef7aba17e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.177777 May 17 15:45:08.253719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 229/454] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:08 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:08.719887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:08.720653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:08.727697 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:08.728446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:08.729448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:08.730050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:08.767781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:08.768276 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:08.768925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lazy-loading 'fault' on Instance uuid 290d1a3d-abf8-4e35-91e7-836323f7c29a {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:45:08.828166 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:08.838142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-adf1d8c2-78b0-4947-b43f-9d5461ff0b75 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1305 microversion: 2.1 time: 0.122164 May 17 15:45:08.838737 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 226/455] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:08 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:09.274104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:09.275726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:09.281954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:09.282513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:09.283358 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:09.284013 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:09.437463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:09.446589 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-893392b9-4408-4aa9-84f2-56987f841ee1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.179500 May 17 15:45:09.447741 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 230/456] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:09 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:09.855174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:09.855808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:09.862464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:09.863221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:09.864061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:09.864558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:09.896208 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:09.896754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:09.897265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lazy-loading 'fault' on Instance uuid 290d1a3d-abf8-4e35-91e7-836323f7c29a {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:45:09.954188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:09.962950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ae527c3b-16e1-4d87-9c16-011ca8630b68 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1305 microversion: 2.1 time: 0.111688 May 17 15:45:09.963730 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 227/457] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:09 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:10.464078 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:10.465620 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:10.479078 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:10.479555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:10.480360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:10.480803 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:10.656478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:10.664676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2b4fd1b3-12b5-4ab3-9c42-69473fc1763c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1510 microversion: 2.1 time: 0.204654 May 17 15:45:10.674139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 231/458] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:10 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:10.980737 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:10.981381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:10.987492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:10.987942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:10.989460 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:10.989895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:11.022031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:11.022495 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:11.022951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lazy-loading 'fault' on Instance uuid 290d1a3d-abf8-4e35-91e7-836323f7c29a {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:45:11.071390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b860a94349204b7d86ad796882dcd402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff5f34a5094ef9a5c8c4b5b924415b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:11.079352 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f61e24cf-a883-44e7-b910-4533fb828f09 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 200 len: 1305 microversion: 2.1 time: 0.103315 May 17 15:45:11.089002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 228/459] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:10 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:11.690541 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:11.691219 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:11.698776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:11.699565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:11.700706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:11.701424 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:12.000196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:12.027594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b3fd69a1-122e-4166-8a21-1224f55c3528 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1516 microversion: 2.1 time: 0.347522 May 17 15:45:12.029095 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 232/460] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:11 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:12.095873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:12.096492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] [instance: 290d1a3d-abf8-4e35-91e7-836323f7c29a] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:12.103200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:12.103744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:12.104528 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:12.104967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:12.119714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] HTTP exception thrown: Instance 290d1a3d-abf8-4e35-91e7-836323f7c29a could not be found. May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Request method failure captured: May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a HTTP/1.1 May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8LctAVXWDi7_umMSmYegCSbBPPvdylcWez6yjQHYzqfg2SFcCiKIxVAnw6Mm6I9JJ8ju4FqdOP_4UbJuv5rAY2MHNz8sUwrb990YvZPp-mPdx6LN7MotrkAnFUJJhzpM-EFeMU4HAJN00Ry8y-npUF4Ytx4Cy3D5r3QbxzQs2I7Pys May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 29ff5f34a5094ef9a5c8c4b5b924415b May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesNegativeTest-710217526 May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:45:12.121482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/29ff5f34a5094ef9a5c8c4b5b924415b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_29ff5f34a5094ef9a5c8c4b5b924415b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/29ff5f34a5094ef9a5c8c4b5b924415b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/29ff5f34a5094ef9a5c8c4b5b924415b"}]}] May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesNegativeTest-710217526 May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 29ff5f34a5094ef9a5c8c4b5b924415b May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesNegativeTest-710217526 May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesNegativeTest-710217526-project May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: b860a94349204b7d86ad796882dcd402 May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesNegativeTest-710217526-project May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 290d1a3d-abf8-4e35-91e7-836323f7c29a could not be found. May 17 15:45:12.123057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '290d1a3d-abf8-4e35-91e7-836323f7c29a'} May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290d1a3d-abf8-4e35-91e7-836323f7c29a could not be found. May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:45:12.123896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290d1a3d-abf8-4e35-91e7-836323f7c29a could not be found. May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290d1a3d-abf8-4e35-91e7-836323f7c29a could not be found. May 17 15:45:12.125077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:45:12.126372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] Returning 404 to user: Instance 290d1a3d-abf8-4e35-91e7-836323f7c29a could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:45:12.126372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-95239f15-e84a-4073-925b-5f8497d45272 tempest-VolumesNegativeTest-710217526 tempest-VolumesNegativeTest-710217526-project] 10.222.0.75 "GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a" status: 404 len: 111 microversion: 2.1 time: 0.030838 May 17 15:45:12.126372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 229/461] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:12 2022] GET /compute/v2.1/servers/290d1a3d-abf8-4e35-91e7-836323f7c29a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:45:13.573321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8a0e4e90-7493-4879-bbfe-211576e87d87 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'create', calling method: .version_select at 0x7f83f7545a60>, body: {"keypair": {"name": "tempest-keypair-1267602904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZhRPjGA2kYbkyEnFrqRJuT7Xwp+MwPQtIl9Mk3t/Tx5JPe8igL7M1FTiVKV2cRSYkv9Iua5OlRbpvqG1jiQc3cSvhsAz2JWfhqlCZm+Hhbwr7kK7HwgScE5vQjNFvpXw=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:13.601086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-8a0e4e90-7493-4879-bbfe-211576e87d87 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:45:13.610685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-8a0e4e90-7493-4879-bbfe-211576e87d87 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for user b40c7b11fff443fa8c78e8647703e230 and project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:45:13.675563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8a0e4e90-7493-4879-bbfe-211576e87d87 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106858 May 17 15:45:13.684538 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 233/462] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:45:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:45:15.729839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-683367789", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f39fe23b-2a86-42fb-8f1f-eed84bd4ed4f"}], "security_groups": [{"name": "tempest-securitygroup--248286245"}], "key_name": "tempest-keypair-1267602904", "user_data": "}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:15.895583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] validate_networks() for [('f39fe23b-2a86-42fb-8f1f-eed84bd4ed4f', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:45:16.348505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:45:16.349168 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:45:16.349667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:45:16.350389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:45:16.350894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:45:16.361758 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:16.362267 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:16.363795 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:16.364420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:16.383216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:45:16.387583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Getting quotas for user b40c7b11fff443fa8c78e8647703e230 and project 87cc0cd3d0df4dccbc28058b6866d076. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:45:16.399466 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:45:16.402068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:45:16.447772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [2331af9b-6f28-4ed6-a0e6-b8db75ac6eb1] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 15:45:17.457929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [2331af9b-6f28-4ed6-a0e6-b8db75ac6eb1] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 53710. May 17 15:45:17.470315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-fcd8e041-78dd-4082-a03c-bcb6d75d467f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.744974 May 17 15:45:17.476445 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 230/463] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:45:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:45:17.487403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-13d2e5ac-49e0-40cf-8b8e-539ba627992e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:17.488386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-13d2e5ac-49e0-40cf-8b8e-539ba627992e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:17.600969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-13d2e5ac-49e0-40cf-8b8e-539ba627992e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:17.613264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-13d2e5ac-49e0-40cf-8b8e-539ba627992e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1245 microversion: 2.1 time: 0.128038 May 17 15:45:17.623896 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 234/464] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:17 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:18.632246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:18.633691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:18.641728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:18.642655 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:18.646141 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:18.646141 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:18.717905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:18.737358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9440fc15-1d97-46af-99a1-53d0a124e2f0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1297 microversion: 2.1 time: 0.110390 May 17 15:45:18.738050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 231/465] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:18 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:45:19.757199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:19.757809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:19.770656 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:19.771110 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:19.778807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:19.779264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:19.923619 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:19.943946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a0c559c6-4bd5-4e8b-bb32-64f356860498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1303 microversion: 2.1 time: 0.191493 May 17 15:45:19.948779 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 235/466] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:19 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:20.968917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:20.970260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:20.985088 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:20.985547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:20.986395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:20.986832 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:21.355562 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:21.363623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2c99c51b-cb13-47d3-b199-9e887d40b807 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.402147 May 17 15:45:21.369194 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 232/467] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:20 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:21.521516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-72dd0c9a-b042-4dcc-8198-271d9cd60c3d req-84818916-45b6-4081-ae83-901a80598782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9d0cdd-63f7-4a69-900b-583bbb9a11f3", "tag": "58496923-8c39-489f-ae0c-a030f0c47bcc"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:21.537878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-72dd0c9a-b042-4dcc-8198-271d9cd60c3d req-84818916-45b6-4081-ae83-901a80598782 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:21.538962 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-72dd0c9a-b042-4dcc-8198-271d9cd60c3d req-84818916-45b6-4081-ae83-901a80598782 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:21.554120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-72dd0c9a-b042-4dcc-8198-271d9cd60c3d req-84818916-45b6-4081-ae83-901a80598782 service nova] Creating event network-changed:58496923-8c39-489f-ae0c-a030f0c47bcc for instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 on hv-cinder-84212 May 17 15:45:21.566111 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-72dd0c9a-b042-4dcc-8198-271d9cd60c3d req-84818916-45b6-4081-ae83-901a80598782 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051352 May 17 15:45:21.571782 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 236/468] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:45:21.958714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 15:45:21.958965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 15:45:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 15:45:22.387655 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:22.389335 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:22.412680 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:22.413167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:22.413993 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:22.414457 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:22.685099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:22.707804 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f3eaa5db-6340-4d49-a90e-7c14ea214120 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.325967 May 17 15:45:22.717304 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 233/469] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:22 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:23.727204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:23.728572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:23.745502 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:23.746161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:23.747442 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:23.748505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:24.014390 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:24.023211 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-eaeffb38-f559-4e93-918a-ed95b86204f3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.301659 May 17 15:45:24.033229 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 237/470] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:23 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:25.040853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:25.041523 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:25.048259 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:25.049281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:25.050488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:25.051087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:25.230742 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:25.239469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7295b38e-3259-464e-acef-5e7609f09498 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.202601 May 17 15:45:25.240274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 234/471] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:25 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:26.257284 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:26.257879 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:26.264292 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:26.265731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:26.267268 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:26.267731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:26.823827 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:26.833774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5e5da703-ce69-4f26-b05d-d3752e0be4fd tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.581149 May 17 15:45:26.843806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 238/472] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:26 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:27.851578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:27.852441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:27.858893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:27.859692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:27.860478 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:27.860914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:28.096194 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:28.117174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c29a8fc7-0740-4956-9c2f-ce8a9610385a tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.269145 May 17 15:45:28.118734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 235/473] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:27 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:29.134689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:29.135956 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:29.145171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:29.149954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:29.151842 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:29.153901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:30.046854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:30.060085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-96db4669-2d9d-4abf-aa44-195b90250c29 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.929164 May 17 15:45:30.060673 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 239/474] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:29 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:31.077091 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:31.077704 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:31.093713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:31.100930 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:31.101953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:31.102691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:31.295230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:31.307497 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-787bcb59-81ca-4840-8b2f-cc4cbf6de181 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.234502 May 17 15:45:31.308444 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 236/475] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:31 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:31.328072 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-abd8ccb0-367e-414f-acef-a09a85c9d36d req-33882112-4b20-4448-a3ac-5fdabc56b9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9d0cdd-63f7-4a69-900b-583bbb9a11f3", "name": "network-vif-plugged", "status": "completed", "tag": "58496923-8c39-489f-ae0c-a030f0c47bcc"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:31.346890 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-abd8ccb0-367e-414f-acef-a09a85c9d36d req-33882112-4b20-4448-a3ac-5fdabc56b9d1 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:31.348105 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-abd8ccb0-367e-414f-acef-a09a85c9d36d req-33882112-4b20-4448-a3ac-5fdabc56b9d1 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:31.376646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-abd8ccb0-367e-414f-acef-a09a85c9d36d req-33882112-4b20-4448-a3ac-5fdabc56b9d1 service nova] Creating event network-vif-plugged:58496923-8c39-489f-ae0c-a030f0c47bcc for instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 on hv-cinder-84212 May 17 15:45:31.398060 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-abd8ccb0-367e-414f-acef-a09a85c9d36d req-33882112-4b20-4448-a3ac-5fdabc56b9d1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071293 May 17 15:45:31.400770 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 240/476] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:45:31.712698 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c13614bd-35b9-44ce-b3ae-3779f6f276db tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Action: 'create', calling method: .version_select at 0x7f83f75c6dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1475883912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPNnVVukUJbf7BBWkZFqCVaGpnxz/OX9IhjTrGRPrKZRiWj6qSCKhCSDq4oG71I/3O9gbCG+3SGk5677VQURnaZ57gKD8Z5ZOMNsngp2RPEuTikmi0jg6gwBkPmNOdFrA=="}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:31.739571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-c13614bd-35b9-44ce-b3ae-3779f6f276db tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Getting quotas for project 4f8e659223ca4c2a8f4c6836e6a1cc18. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:45:31.744243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-c13614bd-35b9-44ce-b3ae-3779f6f276db tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Getting quotas for user 7b0e466b56814e10a27304db1bb7b262 and project 4f8e659223ca4c2a8f4c6836e6a1cc18. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:45:31.770573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c13614bd-35b9-44ce-b3ae-3779f6f276db tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.396106 May 17 15:45:31.771161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 237/477] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:45:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:45:32.325520 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:32.326295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:32.332761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:32.333355 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:32.334362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:32.335046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:32.497487 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:32.504802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a307b53d-4170-4c16-805e-ceeb1d573ec6 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.183721 May 17 15:45:32.505378 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 241/478] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:32 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:33.523508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:33.524127 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:33.534182 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:33.535425 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:33.536403 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:33.537754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:33.688342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:33.697291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-32464f89-cc8f-4c45-83b4-c36c39fa0625 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1370 microversion: 2.1 time: 0.179266 May 17 15:45:33.698189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 238/479] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:33 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:34.715127 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:34.715836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:34.723615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:34.724197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:34.725027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:34.725474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:34.866547 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:45:34.874907 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-cd17f7c8-f586-4e82-82ee-2c0fab6c6152 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1564 microversion: 2.1 time: 0.163651 May 17 15:45:34.875496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 242/480] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:45:34 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:45:34.892089 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:45:34.892574 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:45:34.898557 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:34.899000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:34.899790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:34.900231 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:34.979628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a471bad0-fad1-4c89-8479-32429352e5d9 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091400 May 17 15:45:34.980232 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 239/481] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:45:34 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:45:35.930395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-c2ac397e-78e3-4265-8e4d-ffa9a5adbaca req-75b35079-2e99-49a6-ae1e-a2ef6308a33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9d0cdd-63f7-4a69-900b-583bbb9a11f3", "tag": "58496923-8c39-489f-ae0c-a030f0c47bcc"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:45:35.939769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-c2ac397e-78e3-4265-8e4d-ffa9a5adbaca req-75b35079-2e99-49a6-ae1e-a2ef6308a33e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:45:35.940697 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-c2ac397e-78e3-4265-8e4d-ffa9a5adbaca req-75b35079-2e99-49a6-ae1e-a2ef6308a33e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:45:35.953812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-c2ac397e-78e3-4265-8e4d-ffa9a5adbaca req-75b35079-2e99-49a6-ae1e-a2ef6308a33e service nova] Creating event network-changed:58496923-8c39-489f-ae0c-a030f0c47bcc for instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 on hv-cinder-84212 May 17 15:45:35.959994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-c2ac397e-78e3-4265-8e4d-ffa9a5adbaca req-75b35079-2e99-49a6-ae1e-a2ef6308a33e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 May 17 15:45:35.960883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 243/482] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:05.754540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-636822499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1475883912", "security_groups": [{"name": "tempest-secgroup-smoke-972220404"}], "networks": [{"uuid": "a771620b-dc1b-42bb-88f6-2cf9877af5b9"}], "block_device_mapping_v2": [{"uuid": "6e3e0840-c20e-48f3-87bc-c52cc72375f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:05.860748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] validate_networks() for [('a771620b-dc1b-42bb-88f6-2cf9877af5b9', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:46:06.215989 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:46:06.216415 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:46:06.216887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:46:06.217328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:46:06.217735 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:46:06.226363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:06.226734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:06.227845 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:06.228277 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:06.246012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Getting quotas for project 4f8e659223ca4c2a8f4c6836e6a1cc18. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:46:06.249686 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Getting quotas for user 7b0e466b56814e10a27304db1bb7b262 and project 4f8e659223ca4c2a8f4c6836e6a1cc18. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:46:06.305366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:46:06.307366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e3e0840-c20e-48f3-87bc-c52cc72375f4',volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:46:06.429107 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-633895f4-8c0d-4898-8715-cf720af7add8 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.678496 May 17 15:46:06.429751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 240/483] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:46:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:46:06.441190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-45da0318-8a7f-4e5f-96b5-93a3bc7d4814 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:06.441887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-45da0318-8a7f-4e5f-96b5-93a3bc7d4814 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:06.496874 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-45da0318-8a7f-4e5f-96b5-93a3bc7d4814 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:06.504401 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-45da0318-8a7f-4e5f-96b5-93a3bc7d4814 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1088 microversion: 2.1 time: 0.068498 May 17 15:46:06.504978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 244/484] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:06 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:07.522507 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:07.523113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:07.529019 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:07.529459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:07.530252 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:07.530677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:07.619239 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:07.626708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a58ba925-c6c1-462e-90cb-7e5d99c0af24 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1204 microversion: 2.1 time: 0.108791 May 17 15:46:07.627348 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 241/485] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:07 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:08.644950 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:08.645882 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:08.653989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:08.654471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:08.655306 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:08.655955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:08.899860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:08.907642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-926b0ad4-7a14-4aad-83d3-7ec4b9c5caec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.266777 May 17 15:46:08.908933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 245/486] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:08 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:09.060967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-225264d3-ccb7-49e2-bdd7-9a2565ce4e92 req-738190d2-9538-4910-98cd-4b3bb8500221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:09.071446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-225264d3-ccb7-49e2-bdd7-9a2565ce4e92 req-738190d2-9538-4910-98cd-4b3bb8500221 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:09.072310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-225264d3-ccb7-49e2-bdd7-9a2565ce4e92 req-738190d2-9538-4910-98cd-4b3bb8500221 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:09.087552 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-225264d3-ccb7-49e2-bdd7-9a2565ce4e92 req-738190d2-9538-4910-98cd-4b3bb8500221 service nova] Creating event network-changed:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:46:09.092308 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-225264d3-ccb7-49e2-bdd7-9a2565ce4e92 req-738190d2-9538-4910-98cd-4b3bb8500221 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036448 May 17 15:46:09.092906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 242/487] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:46:09.925709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:09.926392 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:09.932933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:09.933388 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:09.934201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:09.934646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:10.081248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:10.088501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a02f43ba-153c-4935-8a12-c0a7903c5d7f tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.166792 May 17 15:46:10.089081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 246/488] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:09 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:10.398243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:10.398787 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:10.404854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:10.405295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:10.406072 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:10.406501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:10.428624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-00145ed5-8c07-42c9-84f9-28f0e1bfd8f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/ips" status: 200 len: 150 microversion: 2.20 time: 0.034722 May 17 15:46:10.429169 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 243/489] 10.222.0.75 () {60 vars in 1288 bytes} [Tue May 17 15:46:10 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:46:11.105469 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:11.106116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:11.112468 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:11.112909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:11.113670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:11.114138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:11.239983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:11.247448 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-58a528b2-8e01-44ae-879c-37bfd44300e7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.146108 May 17 15:46:11.248018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 247/490] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:11 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:12.264182 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:12.264782 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:12.270676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:12.271121 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:12.271881 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:12.272319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:12.437062 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:12.444464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ae0b28e0-4980-4b38-a05e-24dd8c8b644a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.184140 May 17 15:46:12.445025 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 244/491] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:12 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:13.461235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:13.461857 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:13.468344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:13.468796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:13.469568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:13.470022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:13.518189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:13.518762 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:13.524764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:13.525211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:13.525979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:13.526434 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:13.550026 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lazy-loading 'flavor' on Instance uuid 4a13b9b5-8727-4b05-aa28-b74aad598788 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:46:13.601521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:13.610774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4c5e2f97-d1e2-435f-8a46-7e7b1cb3b986 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.153058 May 17 15:46:13.611501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 248/492] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:13 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:13.807539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b46da39b-0bfb-4110-b012-ec181b147e57 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/action" status: 202 len: 0 microversion: 2.20 time: 0.293598 May 17 15:46:13.808189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 245/493] 10.222.0.75 () {62 vars in 1318 bytes} [Tue May 17 15:46:13 2022] POST /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 15:46:13.817244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:13.817851 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:13.823717 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:13.824174 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:13.825012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:13.825449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:13.951781 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:13.960198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:13.961694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:13.962866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bc94ce49-1b5b-441e-9022-e4bec907b4c3 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.150343 May 17 15:46:13.963424 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 249/494] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:13 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:14.628597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:14.629326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:14.635664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:14.636122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:14.636893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:14.637330 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:14.766263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:14.774071 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-14e6df45-46ef-4500-be82-d89a75aaf411 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.150005 May 17 15:46:14.774707 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 246/495] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:14 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:14.981332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:14.981903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:14.988471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:14.988926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:14.989724 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:14.990223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:15.118833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:15.126518 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:15.128083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:15.129258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bce361e8-b121-4312-a3ef-434832c1b923 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.152496 May 17 15:46:15.129822 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 250/496] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:14 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:15.791325 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:15.791944 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:15.797851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:15.798322 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:15.799076 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:15.800012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:15.930538 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:15.937839 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9d8ab6f5-e4ac-496f-a666-504aa0596198 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.150369 May 17 15:46:15.938433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 247/497] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:15 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:16.147605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:16.148221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:16.154556 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:16.155012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:16.155780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:16.156224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:16.280316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:16.288654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:16.290201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:16.291358 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b3d745b0-e089-4c05-960d-535b14fb1f54 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.147591 May 17 15:46:16.291923 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 251/498] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:16 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:16.953706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:16.954272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:16.960143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:16.960587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:16.961336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:16.961765 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:17.090613 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:17.098718 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-29d9ab3e-3716-4fab-8907-3fa87bb53988 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.148722 May 17 15:46:17.099060 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 248/499] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:16 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:17.308423 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:17.309028 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:17.315362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:17.318874 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:17.318874 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:17.318874 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:17.453096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:17.461587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:17.463131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:17.464303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fc156831-a5fc-427f-a019-66883285dd3d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.159653 May 17 15:46:17.464956 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 252/500] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:17 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:18.116682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:18.117407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:18.123387 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:18.123910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:18.124752 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:18.125194 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:18.251508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:18.259417 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f96546e6-5503-432e-8561-4f948857e413 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.147475 May 17 15:46:18.259981 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 249/501] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:18 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:18.482888 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:18.483498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:18.490371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:18.490824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:18.491591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:18.492029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:18.619154 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:18.627006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:18.629106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:18.630308 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-259638a8-4519-4b84-94b6-08ce3c242d66 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.151268 May 17 15:46:18.630863 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 253/502] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:18 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:19.276500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:19.277102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:19.283068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:19.283454 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:19.284843 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:19.285300 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:19.411886 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:19.419156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b4b7e88e-3021-48cb-a9b6-f5cc3f564cec tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.146477 May 17 15:46:19.419719 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 250/503] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:19 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:19.527049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:19.527604 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:19.534739 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:19.535141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:19.536141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:19.536590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:19.560582 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2980e8be-3e4f-49e5-a9c0-a8c1690d9d94 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/ips" status: 200 len: 150 microversion: 2.1 time: 0.037393 May 17 15:46:19.561167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 254/504] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:46:19 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:19.649088 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:19.649845 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:19.655674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:19.656315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:19.657080 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:19.657509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:19.814479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:19.823298 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:19.824872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:19.826299 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3c3708fa-27c9-4532-a1b4-daaac98dbcbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.180993 May 17 15:46:19.826935 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 251/505] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:19 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:20.436106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:20.436643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:20.443216 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:20.443664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:20.444441 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:20.444883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:20.576852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:20.584259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b3d3a408-4d4a-4110-8563-f394aeef8e7b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.152223 May 17 15:46:20.584850 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 255/506] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:20 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:20.845371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:20.845982 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:20.852823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:20.853273 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:20.854061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:20.854498 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:20.940894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "800740fc-8f84-47a3-886e-67d44c0620d9"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:20.942043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:20.948022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:20.948473 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:20.949280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:20.949714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:20.993349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:21.004985 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:21.009286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:21.011145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ac270b89-4ff6-4e2a-ad41-21a5393ac212 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.169682 May 17 15:46:21.012310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 252/507] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:20 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:21.146784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a3805511-56c2-4740-b53b-10870524f883 req-752eb9f6-3a0b-44f7-8469-8d1fe7b3ef1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "name": "network-vif-plugged", "status": "completed", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:21.162680 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a3805511-56c2-4740-b53b-10870524f883 req-752eb9f6-3a0b-44f7-8469-8d1fe7b3ef1b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:21.163183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a3805511-56c2-4740-b53b-10870524f883 req-752eb9f6-3a0b-44f7-8469-8d1fe7b3ef1b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:21.183663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a3805511-56c2-4740-b53b-10870524f883 req-752eb9f6-3a0b-44f7-8469-8d1fe7b3ef1b service nova] Creating event network-vif-plugged:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:46:21.190168 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-a3805511-56c2-4740-b53b-10870524f883 req-752eb9f6-3a0b-44f7-8469-8d1fe7b3ef1b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051097 May 17 15:46:21.191018 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 253/508] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:46:21.221053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-aa48bde7-6ea2-4cf7-97ed-74d437eaf46a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284377 May 17 15:46:21.222558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 256/509] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:46:20 2022] POST /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:46:21.602457 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:21.603065 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:21.609234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:21.609701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:21.610484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:21.610918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:21.744077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:21.751691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f058c560-f611-4f02-9e9f-08dcb013c090 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.153813 May 17 15:46:21.752260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 254/510] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:21 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:22.032435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:22.033142 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:22.039600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:22.040056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:22.040828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:22.041272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:22.168775 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:22.176528 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:22.178072 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:22.179240 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1604f050-7879-4cf5-b003-0e1c4cf6f6a8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.151547 May 17 15:46:22.179802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 257/511] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:22 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:22.769477 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:22.770128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:22.776740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:22.777405 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:22.778397 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:22.778842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:22.933594 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:22.941873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b62dbc27-1c56-4f91-9fb2-c1bb59aedd0b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1259 microversion: 2.1 time: 0.176570 May 17 15:46:22.942603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 255/512] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:22 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:23.198138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:23.198744 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:23.205012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:23.205979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:23.206767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:23.207199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:23.333435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:23.341615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:23.343185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:23.344359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1416e8ce-a826-45c3-9ba9-a6c770e45bb5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.150224 May 17 15:46:23.344926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 258/513] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:23 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:23.958966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:23.959579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:23.965446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:23.965920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:23.966722 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:23.967189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:24.091128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:24.098394 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-951d9b3b-0e43-400e-9b8a-c6004c365277 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1444 microversion: 2.1 time: 0.143213 May 17 15:46:24.098967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 256/514] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:23 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:46:24.115461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:24.116094 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:24.122393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:24.122840 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:24.123682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:24.124114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:24.262380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:24.269697 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c576fdda-bdf9-44c5-9e84-66a3016913b7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1444 microversion: 2.1 time: 0.158628 May 17 15:46:24.270328 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 259/515] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:24 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:24.363801 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:24.364520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:24.370337 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:24.370991 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:24.371752 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:24.372179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:24.536643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:24.544411 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:24.545922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:24.547105 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0e26d7d1-283a-40ea-aa32-9c0b27e1d5a7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.187661 May 17 15:46:24.547666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 257/516] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:24 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:25.564978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:25.565591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:25.571676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:25.572128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:25.572893 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:25.573330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:25.709679 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:25.717677 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:25.719237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:25.720594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bdf22961-ad65-4f70-b2e0-8655e8b27318 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.159642 May 17 15:46:25.731760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 260/517] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:25 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:26.301326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-574fae9f-c9e1-45c7-b07b-02451854dbbd req-03e6799b-e64a-4ee7-bcf1-a01f0c03092e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:26.309140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-574fae9f-c9e1-45c7-b07b-02451854dbbd req-03e6799b-e64a-4ee7-bcf1-a01f0c03092e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:26.309586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-574fae9f-c9e1-45c7-b07b-02451854dbbd req-03e6799b-e64a-4ee7-bcf1-a01f0c03092e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:26.321247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-574fae9f-c9e1-45c7-b07b-02451854dbbd req-03e6799b-e64a-4ee7-bcf1-a01f0c03092e service nova] Creating event network-changed:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:46:26.326352 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-574fae9f-c9e1-45c7-b07b-02451854dbbd req-03e6799b-e64a-4ee7-bcf1-a01f0c03092e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028792 May 17 15:46:26.327261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 258/518] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:26.739823 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:26.740894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:26.747513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:26.748132 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:26.748946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:26.749463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:26.918928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:26.927631 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:26.929192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:26.930695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-94d0c160-9fd7-4f56-a97a-dfd07f31c69d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.195436 May 17 15:46:26.931264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 261/519] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:26 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:27.951797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:27.952491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:27.958564 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:27.959017 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:27.959778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:27.960215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:28.087044 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:28.094734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:28.096742 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:28.097887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-597b446e-8c5c-40af-a56d-d995f4baba97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.150409 May 17 15:46:28.098479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 259/520] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:27 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:28.719702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d8088f50-f43f-4757-9c5d-51a36abd767a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: .version_select at 0x7f83f74ed820>, body: {"keypair": {"name": "tempest-keypair-2077534285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjxVEUg8Qh4Sogl6zheduD3yCg76PHAsYL7xlYqrXJ48YkghWri/hBuGOlPFuPG/EFyBzUKCRxKrDhCwVXvOi6qy+hGunwF3ULDRpS55KjM5Bntqdk4fBYcqfx7Iq0ECQ=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:28.735207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-d8088f50-f43f-4757-9c5d-51a36abd767a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:46:28.739046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-d8088f50-f43f-4757-9c5d-51a36abd767a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:46:28.760451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d8088f50-f43f-4757-9c5d-51a36abd767a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044615 May 17 15:46:28.761044 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 262/521] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:46:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:29.117331 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:29.118536 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:29.125403 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:29.125874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:29.126703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:29.127986 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:29.187941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-3f2698c5-6880-41f2-8e33-5c761891f1c0 req-9991cf1e-4d3f-42c2-ad77-cced5c66f5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "name": "network-vif-plugged", "status": "completed", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:29.198026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-3f2698c5-6880-41f2-8e33-5c761891f1c0 req-9991cf1e-4d3f-42c2-ad77-cced5c66f5ae service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:29.199082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-3f2698c5-6880-41f2-8e33-5c761891f1c0 req-9991cf1e-4d3f-42c2-ad77-cced5c66f5ae service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:29.219243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-3f2698c5-6880-41f2-8e33-5c761891f1c0 req-9991cf1e-4d3f-42c2-ad77-cced5c66f5ae service nova] Creating event network-vif-plugged:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:46:29.224892 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-3f2698c5-6880-41f2-8e33-5c761891f1c0 req-9991cf1e-4d3f-42c2-ad77-cced5c66f5ae service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040632 May 17 15:46:29.226702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 263/522] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:29.288271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:29.296120 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:29.297641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:29.298932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9abccda4-8818-4a59-92f8-220d208a2cbc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.185888 May 17 15:46:29.299993 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 260/523] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:29 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:30.028729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-919253096", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "670d118c-c4c6-4faf-9e34-d28bf36911ac"}], "security_groups": [{"name": "tempest-securitygroup--1095924012"}], "key_name": "tempest-keypair-2077534285", "user_data": "}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:30.125206 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] validate_networks() for [('670d118c-c4c6-4faf-9e34-d28bf36911ac', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:46:30.317382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:30.318044 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:30.323861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:30.324312 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:30.325075 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:30.325510 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:30.526098 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:30.534499 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:30.536057 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:30.537216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3fd5dab7-2887-41b4-a649-4f5a657331fa tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.223658 May 17 15:46:30.537784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 261/524] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:30 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:30.548876 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:46:30.549300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:46:30.549776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:46:30.550231 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:46:30.550640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:46:30.559207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:30.559653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:30.560459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:30.560890 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:30.576916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:46:30.581311 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:46:30.592013 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:46:30.594351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:46:30.640324 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bec1c56c-853d-40e1-a377-acb0f8077a3e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616595 May 17 15:46:30.640965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 264/525] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:46:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:46:30.651465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-72343f6a-c50b-4cca-98e7-d1b9a68b61b8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:30.652151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-72343f6a-c50b-4cca-98e7-d1b9a68b61b8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:30.707019 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-72343f6a-c50b-4cca-98e7-d1b9a68b61b8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:30.713668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-72343f6a-c50b-4cca-98e7-d1b9a68b61b8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1241 microversion: 2.1 time: 0.066064 May 17 15:46:30.723049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 262/526] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:30 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:31.557024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:31.557647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:31.564648 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:31.565097 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:31.565863 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:31.566325 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:31.733205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:31.734039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:31.740934 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:31.741470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:31.742347 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:31.742848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:31.967296 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:31.974603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e618fee2-2373-4032-a8ab-6f672d50fb6e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1299 microversion: 2.1 time: 0.246330 May 17 15:46:31.975261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 263/527] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:31 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:32.015516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:32.023488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:32.025045 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:32.026230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-89a7723e-a556-47a3-aca8-383e5854539d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.473937 May 17 15:46:32.026795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 265/528] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:31 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:32.992442 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:32.993058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:32.999932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:33.000390 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:33.001182 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:33.001807 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:33.044560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:33.045925 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:33.053021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:33.053807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:33.054696 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:33.055209 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:33.261514 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:33.268888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8c1230b9-28c0-40dc-9482-21667f5e1a89 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.280243 May 17 15:46:33.269476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 264/529] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:32 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:33.297058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:33.305445 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:33.306992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:33.308160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0dd06e30-7c8d-47fe-aa5d-0df2136f57a0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.267505 May 17 15:46:33.308724 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 266/530] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:33 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:33.373953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-ef7e5141-5227-4bfe-b4a9-0142a40188bb req-5705d15d-f5de-4d76-a8dd-3f738e112f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ff22a4-3c47-4380-adb5-e6d21abbe224", "tag": "53bc3465-94ae-4238-bd42-43740fcbf4d1"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:33.387330 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ef7e5141-5227-4bfe-b4a9-0142a40188bb req-5705d15d-f5de-4d76-a8dd-3f738e112f35 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:33.387776 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ef7e5141-5227-4bfe-b4a9-0142a40188bb req-5705d15d-f5de-4d76-a8dd-3f738e112f35 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:33.405959 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-ef7e5141-5227-4bfe-b4a9-0142a40188bb req-5705d15d-f5de-4d76-a8dd-3f738e112f35 service nova] Creating event network-changed:53bc3465-94ae-4238-bd42-43740fcbf4d1 for instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 on hv-cinder-84212 May 17 15:46:33.411405 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-ef7e5141-5227-4bfe-b4a9-0142a40188bb req-5705d15d-f5de-4d76-a8dd-3f738e112f35 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042628 May 17 15:46:33.412631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 265/531] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:34.286769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:34.287388 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:34.293719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:34.294211 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:34.294988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:34.295426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:34.327047 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:34.327738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:34.334869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:34.335321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:34.336088 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:34.336522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:34.474205 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:34.481781 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0a7befdc-e8e6-4a88-b461-f14a2f6f8e45 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.199503 May 17 15:46:34.482474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 267/532] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:34 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:34.498733 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:34.506429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:34.507933 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:34.509089 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d653d75c-c125-43f9-b5b3-c7e21df4e671 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.186311 May 17 15:46:34.509649 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 266/533] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:34 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:35.498810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:35.499352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:35.505771 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:35.506330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:35.507107 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:35.507549 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:35.527777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:35.528383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:35.534691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:35.535136 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:35.535896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:35.536326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:35.706128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:35.709324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:35.713871 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0db8f1ee-23e1-4edc-a8ec-736c408c736f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.219024 May 17 15:46:35.714487 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 268/534] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:35 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:35.717161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:35.718694 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:35.719840 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-54198f54-bf20-49f5-ad3e-4c536d573d8b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.195888 May 17 15:46:35.720383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 267/535] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:35 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:36.732082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:36.732625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:36.738778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:36.739409 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:36.739561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:36.740013 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:36.740787 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:36.741225 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:36.745098 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:36.745545 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:36.746324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:36.746756 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:36.930329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:36.933429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:36.937655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bf8ac41b-c792-4ce3-bdcf-a41c81bdaff2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.209834 May 17 15:46:36.938258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 269/536] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:36 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:36.941144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:36.942680 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:36.943820 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-89b3253f-42df-41fe-b82e-52af69656581 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1742 microversion: 2.20 time: 0.209466 May 17 15:46:36.944366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 268/537] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:36 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:37.954810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:37.955464 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:37.963793 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:37.964429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:37.967178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:37.968315 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:37.969318 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:37.970408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:37.972379 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:37.973101 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:37.974306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:37.974741 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:38.247129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:38.255969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:38.257948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:38.258155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:38.259453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-56250b13-d2bb-4a75-8254-5e649f5a8960 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.300845 May 17 15:46:38.260113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 269/538] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:37 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:38.265521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-270d1ebd-d757-4d27-820a-05a8eae55bc3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.314438 May 17 15:46:38.266106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 270/539] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:37 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:39.216179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-b8ca7f47-b07d-406f-aa75-587cf4c2ed0c req-1c5a0c5f-a56d-4d42-b902-7e59966a7655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ff22a4-3c47-4380-adb5-e6d21abbe224", "name": "network-vif-plugged", "status": "completed", "tag": "53bc3465-94ae-4238-bd42-43740fcbf4d1"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:39.226747 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-b8ca7f47-b07d-406f-aa75-587cf4c2ed0c req-1c5a0c5f-a56d-4d42-b902-7e59966a7655 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:39.227547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-b8ca7f47-b07d-406f-aa75-587cf4c2ed0c req-1c5a0c5f-a56d-4d42-b902-7e59966a7655 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:39.247628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-b8ca7f47-b07d-406f-aa75-587cf4c2ed0c req-1c5a0c5f-a56d-4d42-b902-7e59966a7655 service nova] Creating event network-vif-plugged:53bc3465-94ae-4238-bd42-43740fcbf4d1 for instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 on hv-cinder-84212 May 17 15:46:39.252540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-b8ca7f47-b07d-406f-aa75-587cf4c2ed0c req-1c5a0c5f-a56d-4d42-b902-7e59966a7655 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040461 May 17 15:46:39.253151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 270/540] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:39.279705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:39.281037 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:39.285440 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:39.287002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:39.289402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:39.290114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:39.291160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:39.292059 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:39.300387 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:39.301323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:39.302318 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:39.302925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:39.574469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:39.581451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:39.589010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7e5da89a-07df-4d1f-9f3f-fb14548c82eb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.309675 May 17 15:46:39.589592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 271/541] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:39 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:46:39.589786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:39.591660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:39.593108 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3377884b-e71f-4074-83a1-4241c499e18c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.317952 May 17 15:46:39.593729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 271/542] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:39 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:40.609766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:40.610408 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:40.613475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:40.614259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:40.617815 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:40.618306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:40.619129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:40.619574 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:40.621644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:40.622422 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:40.623493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:40.624005 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:40.829680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:40.841809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:40.846214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:40.847866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:40.849057 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-eb54c6df-c972-414b-a513-e9c7b1a510eb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.240504 May 17 15:46:40.849806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 272/543] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:40 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:40.850720 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1f7768c0-f7ac-4689-a966-878baef62dae tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1367 microversion: 2.1 time: 0.244680 May 17 15:46:40.851383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 272/544] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:40 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:46:41.868508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:41.869248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:41.869644 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:41.869748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:41.875362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:41.875513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:41.875808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:41.875937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:41.876569 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:41.876669 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:41.877640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:41.877847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:42.081508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:42.088092 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:42.088825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-fcceac19-f18f-48d1-9970-cfead792c3bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1558 microversion: 2.1 time: 0.224178 May 17 15:46:42.089400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 273/545] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:46:41 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:46:42.096393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:42.097901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:42.099228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-42ab91e7-5a90-410e-b5c5-4766545f2c7f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.234595 May 17 15:46:42.100167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 273/546] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:41 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:42.104726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:42.105212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:42.111507 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:42.111962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:42.112712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:42.113145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:42.200627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-afbb3d61-fd51-412e-8e84-fcbcd6c4dbab tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099780 May 17 15:46:42.201285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 274/547] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:46:42 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:46:43.119300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:43.120273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:43.127384 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:43.128218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:43.129273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:43.130253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:43.449137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:43.464527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:43.475913 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:43.477494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e368a7d1-c734-4c2a-b064-5b2776824770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.361862 May 17 15:46:43.478659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 274/548] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:43 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:43.628434 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-9bf88a0d-90ac-4170-9482-f4a35329ecd7 req-c1031cb6-147f-473a-a727-ac9720363efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ff22a4-3c47-4380-adb5-e6d21abbe224", "tag": "53bc3465-94ae-4238-bd42-43740fcbf4d1"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:43.636824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-9bf88a0d-90ac-4170-9482-f4a35329ecd7 req-c1031cb6-147f-473a-a727-ac9720363efd service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:43.637250 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-9bf88a0d-90ac-4170-9482-f4a35329ecd7 req-c1031cb6-147f-473a-a727-ac9720363efd service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:43.650678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-9bf88a0d-90ac-4170-9482-f4a35329ecd7 req-c1031cb6-147f-473a-a727-ac9720363efd service nova] Creating event network-changed:53bc3465-94ae-4238-bd42-43740fcbf4d1 for instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 on hv-cinder-84212 May 17 15:46:43.656670 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-9bf88a0d-90ac-4170-9482-f4a35329ecd7 req-c1031cb6-147f-473a-a727-ac9720363efd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032394 May 17 15:46:43.660760 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 275/549] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:46:44.496313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:44.497280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:44.504922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:44.505376 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:44.506190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:44.506812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:44.689289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:44.705411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:44.707637 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:44.710639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-efd931d9-e0df-4efd-a7dd-2ee2ddd184cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.216790 May 17 15:46:44.721769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 275/550] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:44 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:45.728706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:45.729611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:45.738359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:45.738802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:45.739816 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:45.740246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:45.905324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:45.916131 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:45.917792 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:45.919517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3786bd3c-f55a-4733-bc60-48143bf36664 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.195451 May 17 15:46:45.920158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 276/551] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:45 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:46.938437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:46.939141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:46.945784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:46.946269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:46.947067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:46.947508 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:47.097051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:47.105075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:47.106615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:47.107750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-da31e717-1bd9-4162-9f61-e9680f1a03de tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.173420 May 17 15:46:47.108309 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 276/552] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:46 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:48.131431 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:48.132110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:48.138167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:48.138618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:48.139385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:48.139850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:48.275447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:48.283201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:48.284699 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:48.285842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9bb9936d-e7a7-48ea-8aee-8225edac9eae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1737 microversion: 2.20 time: 0.158400 May 17 15:46:48.286426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 277/553] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:48 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:49.304670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:49.305416 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:49.311822 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:49.312280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:49.313070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:49.313513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:49.500640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:49.509076 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:49.510638 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:49.511816 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c3d6d62e-f206-48a1-b447-407fd3cc3b25 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1719 microversion: 2.20 time: 0.211128 May 17 15:46:49.512379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 277/554] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:49 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1719 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:50.530327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:50.530867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:50.536877 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:50.537320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:50.538093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:50.538529 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:50.665945 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:50.673672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:50.675197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:50.676344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b50352b6-04a6-4033-ae27-c06aa7bc88af tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1719 microversion: 2.20 time: 0.149999 May 17 15:46:50.676893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 278/555] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:50 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:51.155978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-e5fa9386-b6cd-4c17-9d7f-29de61fff9c8 req-77bce13a-708a-427e-986a-e789dda4a2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "name": "network-vif-unplugged", "status": "completed", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:51.165668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e5fa9386-b6cd-4c17-9d7f-29de61fff9c8 req-77bce13a-708a-427e-986a-e789dda4a2ae service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:51.166223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e5fa9386-b6cd-4c17-9d7f-29de61fff9c8 req-77bce13a-708a-427e-986a-e789dda4a2ae service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:51.178711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-e5fa9386-b6cd-4c17-9d7f-29de61fff9c8 req-77bce13a-708a-427e-986a-e789dda4a2ae service nova] Creating event network-vif-unplugged:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:46:51.183685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-e5fa9386-b6cd-4c17-9d7f-29de61fff9c8 req-77bce13a-708a-427e-986a-e789dda4a2ae service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031591 May 17 15:46:51.184477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 278/556] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:46:51.694570 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:51.695182 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:51.701769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:51.701927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:51.702628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:51.703064 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:51.833720 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:51.841467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:51.843007 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:51.844158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d536c4c8-867c-4c3b-ac48-d7d0836a6612 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1722 microversion: 2.20 time: 0.153548 May 17 15:46:51.844721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 279/557] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:51 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:51.863905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c3cdcb2-39d4-4ff6-9e0d-578cc1132d8b"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:51.865042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:51.871166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:51.871617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:51.872383 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:51.872820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:52.149034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-89875187-8677-4600-bacd-9d3c8bcd6775 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289855 May 17 15:46:52.149672 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 279/558] 10.222.0.75 () {62 vars in 1363 bytes} [Tue May 17 15:46:51 2022] POST /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:46:52.259913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:46:52.260482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:52.266314 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:52.266765 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:52.268160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:52.268629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:52.356341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4d56d128-e066-435c-b623-bb68a7a607ae tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/action" status: 202 len: 0 microversion: 2.20 time: 0.100252 May 17 15:46:52.356942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 280/559] 10.222.0.75 () {62 vars in 1318 bytes} [Tue May 17 15:46:52 2022] POST /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 15:46:52.365172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:52.365934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:52.375514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:52.375967 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:52.376740 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:52.377174 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:52.504844 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:52.513779 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:52.515389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:52.516565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8a80cdb5-309e-4128-9018-bdd477e407b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1748 microversion: 2.20 time: 0.155404 May 17 15:46:52.517896 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 280/560] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:52 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:53.536724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:53.537334 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:53.543246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:53.543695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:53.544480 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:53.544919 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:53.670854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:53.680070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:53.681723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:53.683055 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b3d99f92-f339-46fb-85f5-ae3200cc7e2e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1750 microversion: 2.20 time: 0.150808 May 17 15:46:53.683639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 281/561] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:53 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:54.701705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:54.702498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:54.708844 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:54.709293 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:54.710096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:54.710573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:54.962592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:54.971465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:54.973002 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:54.974449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b4b37ca9-94de-474a-8f59-1468c97c0cc2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.276448 May 17 15:46:54.975015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 281/562] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:54 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:55.992755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:55.993385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:55.999400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:55.999840 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:56.000596 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:56.001027 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:56.138921 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:56.151887 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:56.153815 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:56.155243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6cb41e90-12dd-46e9-bc6f-d1c2956fed32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.166460 May 17 15:46:56.155996 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 282/563] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:55 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:57.173877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:57.174521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:57.180553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:57.180995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:57.181763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:57.182226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:57.308475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:57.318347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:57.319905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:57.321306 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f83fb515-e989-4081-96b3-3381a98bfbaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.151336 May 17 15:46:57.321888 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 282/564] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:57 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:46:58.340413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:58.341822 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:58.349369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:58.350161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:58.351271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:58.351939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:58.542824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:58.551759 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:58.553246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:58.554426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8305a201-639b-4dfd-a54b-8817855b474a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.218309 May 17 15:46:58.555169 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 283/565] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:58 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:46:59.573265 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:46:59.573801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:46:59.580450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:59.580905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:59.581670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:46:59.582140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:46:59.709025 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:59.719340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:59.721708 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:46:59.723273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d488940c-a62c-4165-9882-1ac7f355f620 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.154007 May 17 15:46:59.724441 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 283/566] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:46:59 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:00.742573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:00.743232 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:00.749168 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:00.749618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:00.750421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:00.750864 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:00.880163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:00.888425 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:00.889958 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:00.891216 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-efc6ec45-a6e8-4d83-9282-e72e0fc35183 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.152578 May 17 15:47:00.892401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 284/567] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:00 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:02.031101 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:02.031710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:02.039988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:02.040433 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:02.041198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:02.041633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:02.175051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:02.183782 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:02.185317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:02.186541 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-041b5259-712c-4ca1-ab13-b857a9a99b47 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.279537 May 17 15:47:02.187381 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 284/568] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:01 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:03.205387 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:03.206249 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:03.212411 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:03.212866 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:03.213643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:03.214195 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:03.350971 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:03.359823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:03.362351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:03.363509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ab108855-51e2-4ba6-a96d-1f23d97b5840 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.162040 May 17 15:47:03.364067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 285/569] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:03 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:04.381684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:04.382475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:04.389484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:04.390198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:04.391195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:04.391791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:04.527832 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:04.536740 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:04.538444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:04.540305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6cb0b84b-8c57-4056-9e82-4f91bca0ce97 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.162462 May 17 15:47:04.540998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 285/570] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:04 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:05.560264 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:05.561010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:05.568712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:05.569153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:05.569944 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:05.570397 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:05.705586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:05.713684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:05.715262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:05.716399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a39fa66e-9167-4da6-a23e-18e3ee19bc8a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.160587 May 17 15:47:05.717060 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 286/571] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:05 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:06.737360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:06.738193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:06.745199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:06.746015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:06.747023 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:06.747799 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:06.886794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:06.895030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:06.896548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:06.897704 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c8d7306e-8ed8-4baf-a409-a5b43be329d6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.165842 May 17 15:47:06.898314 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 286/572] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:06 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:07.917077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:07.917720 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:07.923964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:07.924417 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:07.925180 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:07.925620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:08.050543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:08.058729 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:08.060233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:08.061381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7a5e40ed-667a-4805-a142-ac363ad9faa6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.148494 May 17 15:47:08.061953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 287/573] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:07 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:09.081350 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:09.081932 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:09.088695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:09.089165 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:09.089991 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:09.090478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:09.215642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:09.223958 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:09.225480 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:09.226675 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f1182d7a-ca60-4fd5-a622-c267373faaea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.150105 May 17 15:47:09.227496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 287/574] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:09 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:10.245915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:10.246565 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:10.252483 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:10.252943 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:10.253706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:10.254174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:10.384665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:10.393404 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:10.394949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:10.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-178e844c-89dc-41fd-b2d6-f70a6e148c07 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.154087 May 17 15:47:10.396764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 288/575] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:10 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:11.415293 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:11.415827 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:11.421843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:11.422324 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:11.423798 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:11.424235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:11.546637 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:11.555493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:11.556997 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:11.558184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ea6b8f68-e38b-4a60-b0ae-fb60d58b1d4d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.147417 May 17 15:47:11.558737 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 288/576] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:11 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:12.576615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:12.577146 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:12.583577 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:12.584026 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:12.584792 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:12.585230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:12.713372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:12.722401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:12.723927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:12.725072 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-19b9ca4e-e40f-4b8f-81d1-9ff23343a690 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.152468 May 17 15:47:12.725626 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 289/577] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:12 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:13.744007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:13.744612 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:13.751427 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:13.751870 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:13.752633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:13.753066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:13.876778 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:13.884954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:13.886470 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:13.887621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d5bf7727-7533-4ef4-b57e-1cab614f7f0c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.147521 May 17 15:47:13.888183 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 289/578] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:13 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:14.906316 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:14.906847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:14.912743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:14.913200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:14.913963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:14.914425 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:15.044910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:15.053808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:15.055347 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:15.056518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-36cbf9d2-19d0-4b55-86cb-e29203cae1cf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.154154 May 17 15:47:15.057603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 290/579] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:14 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:16.075889 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:16.076516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:16.083085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:16.083544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:16.084326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:16.084763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:16.218282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:16.226794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:16.228561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:16.229718 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9c329881-a348-4e8d-97e0-e4077bb49fa0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.157811 May 17 15:47:16.230342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 290/580] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:16 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:17.248566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:17.249174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:17.255142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:17.255643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:17.256417 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:17.256852 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:17.382223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:17.390568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:17.392078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:17.393819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-76369920-aa1d-4c78-bb6e-75307945b816 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.149137 May 17 15:47:17.394412 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 291/581] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:17 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:18.412311 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:18.412850 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:18.419498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:18.419950 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:18.420709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:18.421146 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:18.549561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:18.557793 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:18.559329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:18.560503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-19c103b4-edb7-48e8-ae9c-ad05c9743f28 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.152767 May 17 15:47:18.561066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 291/582] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:18 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:19.579016 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:19.579556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:19.585456 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:19.585903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:19.586693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:19.587125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:19.711431 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:19.719724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:19.721734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:19.722899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-dcddaa0f-cdb4-4c1c-90db-eac2baf94491 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.147850 May 17 15:47:19.723457 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 292/583] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:19 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:20.741320 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:20.741935 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:20.748326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:20.748785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:20.749567 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:20.750021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:20.878326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:20.886666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:20.888194 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:20.889369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2abf2415-fa4a-4fd2-8606-397186c25e71 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.151946 May 17 15:47:20.889928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 292/584] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:20 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:21.907962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:21.908563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:21.914488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:21.914942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:21.915730 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:21.916168 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:22.041903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:22.050170 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:22.051688 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:22.052841 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-29aeca2e-73c8-40ab-8ccd-176019b69572 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.148799 May 17 15:47:22.053405 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 293/585] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:21 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:23.070658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:23.071471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:23.077963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:23.078446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:23.079219 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:23.080166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:23.210270 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:23.218720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:23.220298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:23.222017 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-238e4b1e-f78c-43e5-ac4f-5788e22288f7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.155316 May 17 15:47:23.222595 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 293/586] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:23 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:24.241190 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:24.241794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:24.247743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:24.248192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:24.248950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:24.249382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:24.374092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:24.382320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:24.383810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:24.384947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a7fcdebe-e3f6-4620-89bb-94acf419e48e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.147692 May 17 15:47:24.385501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 294/587] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:24 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:25.338310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-86530534-0eee-4ba7-a389-5d9186ce19ca req-824ab780-e23e-43eb-8b5a-c4cb9e80cc01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "name": "network-vif-plugged", "status": "completed", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:47:25.347077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-86530534-0eee-4ba7-a389-5d9186ce19ca req-824ab780-e23e-43eb-8b5a-c4cb9e80cc01 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:25.347681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-86530534-0eee-4ba7-a389-5d9186ce19ca req-824ab780-e23e-43eb-8b5a-c4cb9e80cc01 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:25.360035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-86530534-0eee-4ba7-a389-5d9186ce19ca req-824ab780-e23e-43eb-8b5a-c4cb9e80cc01 service nova] Creating event network-vif-plugged:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:47:25.365555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-86530534-0eee-4ba7-a389-5d9186ce19ca req-824ab780-e23e-43eb-8b5a-c4cb9e80cc01 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 May 17 15:47:25.366327 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 294/588] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:47:25.403381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:25.403920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:25.410209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:25.410705 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:25.411701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:25.412002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:25.543391 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:25.552297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:25.553818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:25.555012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-68cb5c21-8f04-4bf3-8ccd-2db43cb14b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.155560 May 17 15:47:25.555578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 295/589] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:25 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:26.574588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:26.575291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:26.581871 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:26.582359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:26.583483 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:26.583932 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:26.709930 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:26.718283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:26.719808 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:26.721633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dc256008-0b1c-4831-b18d-a8647220e7c9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.151360 May 17 15:47:26.722241 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 295/590] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:26 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:27.740812 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:27.741673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:27.747990 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:27.748437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:27.749205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:27.749643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:27.884975 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:27.894202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:27.895700 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:27.896872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cb38026f-bc21-4b56-8759-4a7add3370f1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1806 microversion: 2.20 time: 0.160019 May 17 15:47:27.897608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 296/591] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:27 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:28.915829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:28.916480 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:28.922552 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:28.923010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:28.923785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:28.924277 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:29.048691 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:29.056903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:29.058439 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:29.059602 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8692537c-44c7-43b3-8a4a-28cf854b2801 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1793 microversion: 2.20 time: 0.147757 May 17 15:47:29.060163 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 296/592] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:47:28 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1793 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:47:35.004479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e037f7e-262d-4756-b547-33edaaff6a9e"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:47:35.005589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:35.011485 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:35.011934 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:35.012694 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:35.013126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:35.270344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-746f8238-a468-43d1-9dec-e2e9e5ea9a64 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368203 May 17 15:47:35.271013 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 297/593] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:47:34 2022] POST /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:47:42.747755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:47:42.748694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:42.755511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:42.755958 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:42.756720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:42.757155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:42.779552 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'flavor' on Instance uuid 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:47:42.930789 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6c7e7211-210d-4059-bedf-7369892a33c3 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/action" status: 200 len: 32 microversion: 2.1 time: 0.186766 May 17 15:47:42.931365 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 297/594] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:47:42 2022] POST /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:47:42.942252 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:42.942968 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:42.949636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:42.950149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:42.950918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:42.951343 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:43.393070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:43.400916 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-19e6d817-7470-497b-9a50-8820e4bd5c7e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.463920 May 17 15:47:43.401618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 298/595] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:42 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:44.419697 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:44.420330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:44.427287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:44.427749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:44.428522 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:44.428963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:44.552912 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:44.560711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c49cb831-d722-4017-877a-a9238241b6cb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.145796 May 17 15:47:44.561285 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 298/596] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:44 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:45.577895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:45.578465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:45.584708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:45.585155 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:45.585910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:45.586368 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:45.709743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:45.717489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0b3ee9bf-73b8-4160-938b-d9d71b4c6bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.143553 May 17 15:47:45.718266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 299/597] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:45 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:46.736579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:46.737199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:46.743606 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:46.744062 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:46.744836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:46.745276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:46.874348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:46.882939 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4f1947c4-60a1-4419-8128-a09754e2dbb0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.151604 May 17 15:47:46.883523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 299/598] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:46 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:47.900001 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:47.900609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:47.907184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:47.907639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:47.908410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:47.908856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:48.037420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:48.045263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-03857b29-ae11-4aab-adfd-1db4335d28b8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.149070 May 17 15:47:48.045827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 300/599] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:47 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:49.062105 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:49.062639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:49.069543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:49.069989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:49.070789 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:49.071226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:49.198746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:49.206598 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dfb965fa-75cc-467a-b82b-0742aab04a0e tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.148484 May 17 15:47:49.207160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 300/600] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:49 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:50.224151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:50.224774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:50.231641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:50.232090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:50.232865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:50.233305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:50.359364 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:50.367549 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ca55eadc-01ca-4881-b7f9-8facaecb52f5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.147777 May 17 15:47:50.368110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 301/601] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:50 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:51.385280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:51.385893 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:51.392414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:51.392873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:51.393641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:51.394110 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:51.519531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:51.527363 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b663571f-bc13-404c-a6a8-5530885fc462 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.145925 May 17 15:47:51.527925 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 301/602] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:51 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:52.544787 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:52.545327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:52.552221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:52.552665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:52.553425 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:52.553861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:52.683449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:52.691913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3e53e9be-2405-430d-bb32-3f4d3115d182 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.151136 May 17 15:47:52.692483 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 302/603] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:52 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:53.709198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:53.709810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:53.716185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:53.716674 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:53.717447 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:53.717882 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:53.841776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:53.849548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1d123a9b-1659-4241-9ebb-90572b496965 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.144258 May 17 15:47:53.850150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 302/604] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:53 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:54.867021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:54.867630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:54.873955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:54.874435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:54.875205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:54.875641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:55.002423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:55.010400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-31382ef6-4ce6-479c-bfc6-a9607345c9a1 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.147211 May 17 15:47:55.010976 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 303/605] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:54 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:56.028239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:56.028846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:56.035159 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:56.035609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:56.036375 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:56.036804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:56.160836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:56.168547 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-55811067-7274-4e4c-b844-e0551d1d7b92 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.144142 May 17 15:47:56.169105 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 303/606] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:56 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:57.185969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:57.187015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:57.194503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:57.194955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:57.195731 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:57.196261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:57.336482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:57.344253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-30239c38-8d90-4699-b3fd-42c9ce72a905 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.163031 May 17 15:47:57.344818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 304/607] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:57 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:58.362984 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:58.363621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:58.369708 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:58.370192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:58.370952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:58.371385 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:58.497514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:58.508994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-39d4bdd9-9411-4c96-8d30-d6715febea97 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.150311 May 17 15:47:58.509576 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 304/608] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:58 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:47:59.525546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:47:59.526206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:47:59.533140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:59.533592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:59.534382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:47:59.534821 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:47:59.656944 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:47:59.666558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0620c709-da8e-4963-8e4e-bd868840ab00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.144627 May 17 15:47:59.667190 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 305/609] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:47:59 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:00.684337 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:00.684966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:00.692146 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:00.692600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:00.693377 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:00.693827 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:00.823965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:00.832414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d8abb417-77e0-4644-9dba-60c69d6ca3a7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.151893 May 17 15:48:00.832983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 305/610] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:00 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:01.849321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:01.849862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:01.856452 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:01.856904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:01.857671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:01.858143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:01.985510 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:01.993265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-abb40b4e-5c48-4ef9-947f-0b7c1e709508 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.148513 May 17 15:48:01.993831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 306/611] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:01 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:03.010869 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:03.011417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:03.017686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:03.018732 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:03.019491 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:03.019922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:03.144515 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:03.152682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c2011193-20e4-4167-9feb-f24f12c260ce tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1734 microversion: 2.1 time: 0.145661 May 17 15:48:03.153458 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 306/612] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:03 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:04.170185 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:04.170794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:04.177154 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.177601 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.178388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.178825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.308465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:04.316784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6b6dc8de-140a-4232-8175-21cc1b9671d5 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1714 microversion: 2.1 time: 0.150427 May 17 15:48:04.317354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 307/613] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:04 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:04.369953 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:04.370853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:04.377134 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.377591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.379041 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.379441 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.502142 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] HTTP exception thrown: Cannot 'detach_volume' instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 while it is in vm_state rescued May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Request method failure captured: May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments/1e037f7e-262d-4756-b547-33edaaff6a9e HTTP/1.1 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JLQwW9F_iSrYfsCSJcOyPs6IDUbEVekJsZBZzSip5wVBdO0j7saQv47K7fwvjQSCAfcSJEBbJlBoWtJ1z7eRDag5jZnAgLohF_IEC6l9EDycghetO2wwQyuvcubo5CbCdJ3XvER5o6CMPuZvZ9FIclMk_5_eFR2-IzClgfM_RUI_8 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:48:04.503743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/87cc0cd3d0df4dccbc28058b6866d076"}]}] May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: b40c7b11fff443fa8c78e8647703e230 May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:48:04.505313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Cannot 'detach_volume' instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 while it is in vm_state rescued May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'server_id': '5c9d0cdd-63f7-4a69-900b-583bbb9a11f3', 'id': '1e037f7e-262d-4756-b547-33edaaff6a9e'} May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:48:04.506304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 while it is in vm_state rescued May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 while it is in vm_state rescued May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:04.507942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Returning 409 to user: Cannot 'detach_volume' instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 while it is in vm_state rescued {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:48:04.509289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d512b407-f198-4783-8fbe-1b2ebf42ef20 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments/1e037f7e-262d-4756-b547-33edaaff6a9e" status: 409 len: 152 microversion: 2.1 time: 0.139219 May 17 15:48:04.509289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 307/614] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:48:04 2022] DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments/1e037f7e-262d-4756-b547-33edaaff6a9e => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 15:48:04.514099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:04.514643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:04.521041 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.521496 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.522296 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.522735 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.586371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-89c918bd-1206-4f12-9495-0d2fc2cc1c77 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "POST /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/action" status: 202 len: 0 microversion: 2.1 time: 0.075921 May 17 15:48:04.586993 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 308/615] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:48:04 2022] POST /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:48:04.595531 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:04.596327 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:04.604171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.604628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.605448 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:04.605937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:04.814365 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:04.822201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1ce6bbb1-2e42-4b05-aa34-f15a5df411e4 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1722 microversion: 2.1 time: 0.230899 May 17 15:48:04.822778 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 308/616] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:04 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:05.840849 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:05.841543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:05.848237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:05.848681 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:05.849436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:05.849873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:05.982494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:05.990195 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-401ef823-a8e2-4747-bd3c-0e44c345fe00 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1722 microversion: 2.1 time: 0.154129 May 17 15:48:05.990757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 309/617] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:05 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:07.007482 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:07.008016 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:07.014276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:07.014724 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:07.015488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:07.015921 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:07.140044 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:07.148352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5e31161e-aedf-47df-a6ff-9ca5bd0ead0c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1722 microversion: 2.1 time: 0.144808 May 17 15:48:07.148917 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 309/618] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:07 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:08.164639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:08.165246 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:08.171629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:08.172079 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:08.172840 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:08.173277 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:08.298938 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:08.307233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2518fcd0-7dbf-4664-a9db-1b7c5540df37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1722 microversion: 2.1 time: 0.146466 May 17 15:48:08.307802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 310/619] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:08 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:09.325018 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:09.325630 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:09.331981 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:09.332435 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:09.333206 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:09.333646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:09.470801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:09.479513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f984f661-ecf2-4073-8ef5-e0ad87cfcdf2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1728 microversion: 2.1 time: 0.158370 May 17 15:48:09.480079 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 310/620] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:09 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:09.495642 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:09.496140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:09.502406 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:09.502880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:09.503644 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:09.504080 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:09.580278 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-91b169ba-e9c9-4bc9-b5c6-944600610bbf tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088377 May 17 15:48:09.581413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 311/621] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:48:09 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:10.480278 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-d3cd37fd-02d8-412d-8147-0a10e3bcda81 req-c9e70e02-eef8-41fd-b0ab-1759f5268c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9d0cdd-63f7-4a69-900b-583bbb9a11f3", "tag": "58496923-8c39-489f-ae0c-a030f0c47bcc"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:10.488635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-d3cd37fd-02d8-412d-8147-0a10e3bcda81 req-c9e70e02-eef8-41fd-b0ab-1759f5268c3e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:10.489091 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-d3cd37fd-02d8-412d-8147-0a10e3bcda81 req-c9e70e02-eef8-41fd-b0ab-1759f5268c3e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:10.500014 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-d3cd37fd-02d8-412d-8147-0a10e3bcda81 req-c9e70e02-eef8-41fd-b0ab-1759f5268c3e service nova] Creating event network-changed:58496923-8c39-489f-ae0c-a030f0c47bcc for instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 on hv-cinder-84212 May 17 15:48:10.505659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-d3cd37fd-02d8-412d-8147-0a10e3bcda81 req-c9e70e02-eef8-41fd-b0ab-1759f5268c3e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084990 May 17 15:48:10.506358 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 311/622] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:48:12.520329 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-0757787b-dde7-4030-a017-17e7c3855456 req-e30185d8-202e-43b2-a47b-3cab3c4202ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9d0cdd-63f7-4a69-900b-583bbb9a11f3", "tag": "58496923-8c39-489f-ae0c-a030f0c47bcc"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:12.530078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-0757787b-dde7-4030-a017-17e7c3855456 req-e30185d8-202e-43b2-a47b-3cab3c4202ee service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:12.530521 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-0757787b-dde7-4030-a017-17e7c3855456 req-e30185d8-202e-43b2-a47b-3cab3c4202ee service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:12.541479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-0757787b-dde7-4030-a017-17e7c3855456 req-e30185d8-202e-43b2-a47b-3cab3c4202ee service nova] Creating event network-changed:58496923-8c39-489f-ae0c-a030f0c47bcc for instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 on hv-cinder-84212 May 17 15:48:12.546627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-0757787b-dde7-4030-a017-17e7c3855456 req-e30185d8-202e-43b2-a47b-3cab3c4202ee service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030397 May 17 15:48:12.547554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 312/623] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:32.996694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:32.997319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:33.003468 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.003923 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.004701 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.005146 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.029566 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b4cce69f-3c34-4351-b38b-f445b8efa540 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/ips" status: 200 len: 151 microversion: 2.1 time: 0.088103 May 17 15:48:33.030137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 312/624] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:48:32 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:33.041766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "800740fc-8f84-47a3-886e-67d44c0620d9"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:33.042986 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:33.050165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.050618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.051385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.051823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.126327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Invalid volume: volume 800740fc-8f84-47a3-886e-67d44c0620d9 is already attached to instances: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: POST /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/os-volume_attachments HTTP/1.1 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 74 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:48:33.128031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {"volumeAttachment": {"volumeId": "800740fc-8f84-47a3-886e-67d44c0620d9"}} May 17 15:48:33.129578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Invalid volume: volume 800740fc-8f84-47a3-886e-67d44c0620d9 is already attached to instances: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'server_id': '47ff22a4-3c47-4380-adb5-e6d21abbe224', 'body': {'volumeAttachment': {'volumeId': '800740fc-8f84-47a3-886e-67d44c0620d9'}}} May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 800740fc-8f84-47a3-886e-67d44c0620d9 is already attached to instances: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:33.130677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 800740fc-8f84-47a3-886e-67d44c0620d9 is already attached to instances: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:33.132097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 800740fc-8f84-47a3-886e-67d44c0620d9 is already attached to instances: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 400 to user: Invalid volume: volume 800740fc-8f84-47a3-886e-67d44c0620d9 is already attached to instances: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b8f68517-59c1-44fc-aa7b-4bfa35c04829 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092188 May 17 15:48:33.133623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 313/625] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:48:33 2022] POST /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 15:48:33.138223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:33.138718 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:33.145185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.145633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.146806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.146903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.171398 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:48:33.246713 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6c4a595e-97c5-4f5c-a1a0-af9585fcd0b0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 204 len: 0 microversion: 2.1 time: 0.111798 May 17 15:48:33.247176 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 313/626] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:48:33 2022] DELETE /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:48:33.255925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:33.256542 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:33.263244 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.263702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.264501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:33.264939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:33.390768 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:33.398721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8454ea66-7fd8-49f8-8adc-c294dffb52e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1683 microversion: 2.1 time: 0.147276 May 17 15:48:33.399284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 314/627] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:33 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:34.416618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:34.417253 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:34.423543 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:34.424015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:34.424786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:34.425226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:34.556544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:34.563811 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-17a9ab72-2c38-47c5-938b-9bf23440f727 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1683 microversion: 2.1 time: 0.151553 May 17 15:48:34.564880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 314/628] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:34 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:35.580733 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:35.581438 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:35.587589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:35.588111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:35.588888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:35.589328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:35.765295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:35.773310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-85343cf8-96db-483d-b953-16d960d50207 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 200 len: 1683 microversion: 2.1 time: 0.196474 May 17 15:48:35.773881 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 315/629] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:35 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:36.085722 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-96273076-d767-4e5d-8960-25d75bbe2ffc req-d71897b5-7b30-4d66-a778-de387fd8bad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ff22a4-3c47-4380-adb5-e6d21abbe224", "name": "network-vif-deleted", "tag": "53bc3465-94ae-4238-bd42-43740fcbf4d1"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:36.095411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-96273076-d767-4e5d-8960-25d75bbe2ffc req-d71897b5-7b30-4d66-a778-de387fd8bad4 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:36.095885 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-96273076-d767-4e5d-8960-25d75bbe2ffc req-d71897b5-7b30-4d66-a778-de387fd8bad4 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:36.107995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-96273076-d767-4e5d-8960-25d75bbe2ffc req-d71897b5-7b30-4d66-a778-de387fd8bad4 service nova] Creating event network-vif-deleted:53bc3465-94ae-4238-bd42-43740fcbf4d1 for instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 on hv-cinder-84212 May 17 15:48:36.114862 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-96273076-d767-4e5d-8960-25d75bbe2ffc req-d71897b5-7b30-4d66-a778-de387fd8bad4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032747 May 17 15:48:36.117737 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 315/630] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:36.790590 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:36.791267 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:36.797905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:36.798382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:36.799710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:36.800143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:36.813957 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 HTTP/1.1 May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:48:36.815561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:48:36.816939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '47ff22a4-3c47-4380-adb5-e6d21abbe224'} May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:48:36.817748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:48:36.819447 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:48:36.820568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:48:36.820568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-42572eba-858d-412a-b2c6-d29765796d78 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 404 len: 111 microversion: 2.1 time: 0.030668 May 17 15:48:36.822058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 316/631] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:36 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:48:36.826373 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-44e44f63-1dbd-4e5e-a025-97bde2b089a3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '.version_select at 0x7f83f74ba820>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:36.847081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-44e44f63-1dbd-4e5e-a025-97bde2b089a3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077534285" status: 202 len: 0 microversion: 2.1 time: 0.024775 May 17 15:48:36.847660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 316/632] 10.222.0.75 () {58 vars in 1220 bytes} [Tue May 17 15:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077534285 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:48:37.584621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:37.585116 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:37.591255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:37.591702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:37.592468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:37.592914 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:37.719238 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lazy-loading 'services' on Instance uuid 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:48:37.834621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a3bcf114-67e2-48f0-bfb9-afc166a9d73f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments/800740fc-8f84-47a3-886e-67d44c0620d9" status: 202 len: 0 microversion: 2.1 time: 0.254202 May 17 15:48:37.835265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 317/633] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:48:37 2022] DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments/800740fc-8f84-47a3-886e-67d44c0620d9 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:48:37.843655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:37.844702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:37.853811 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:37.854303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:37.855116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:37.855590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:37.889490 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-80c71a07-910f-4a66-a722-af4ee31f2f4e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049762 May 17 15:48:37.890069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 317/634] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:48:37 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:38.902151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:38.903159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:38.909255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:38.909713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:38.910505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:38.910947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:38.939805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-093d6e36-b577-4154-a848-8616a814ecf7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042013 May 17 15:48:38.940358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 318/635] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:48:38 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:48:38.995249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:38.995716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:39.002398 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:39.002852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:39.003622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:39.004063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:39.029873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:48:39.114645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a91a3e70-459d-4a92-8e6c-a97ed3163c26 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 204 len: 0 microversion: 2.1 time: 0.122928 May 17 15:48:39.115496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 318/636] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:48:38 2022] DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:48:39.123868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:39.124486 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:39.133884 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:39.134401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:39.135187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:39.135629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:39.267723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:39.274976 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-95e6acd9-cf8a-4d21-8283-a2c6192d81f8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1683 microversion: 2.1 time: 0.154948 May 17 15:48:39.275539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 319/637] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:39 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:48:40.292670 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:40.293377 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:40.300230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:40.300690 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:40.301466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:40.301912 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:40.541279 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:40.549221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a46e3e9c-057e-47bc-a723-1dbe827def97 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 200 len: 1683 microversion: 2.1 time: 0.260207 May 17 15:48:40.549825 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 319/638] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:40 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 1683 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:40.921036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-54d4992d-8d48-4c1c-83e5-ef78f08a781d req-d196f510-e90c-4f44-af8a-b32b3d847aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce6ee7f-d1fd-4950-b2b2-6504004d5e01", "name": "network-vif-deleted", "tag": "83c15363-afe5-4cf3-81f7-17976151a63d"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:40.930321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-54d4992d-8d48-4c1c-83e5-ef78f08a781d req-d196f510-e90c-4f44-af8a-b32b3d847aa3 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:40.930857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-54d4992d-8d48-4c1c-83e5-ef78f08a781d req-d196f510-e90c-4f44-af8a-b32b3d847aa3 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:40.944067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-54d4992d-8d48-4c1c-83e5-ef78f08a781d req-d196f510-e90c-4f44-af8a-b32b3d847aa3 service nova] Creating event network-vif-deleted:83c15363-afe5-4cf3-81f7-17976151a63d for instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 on hv-cinder-84212 May 17 15:48:40.949055 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-54d4992d-8d48-4c1c-83e5-ef78f08a781d req-d196f510-e90c-4f44-af8a-b32b3d847aa3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032071 May 17 15:48:40.949689 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 320/639] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:41.567993 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:41.568606 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:41.575449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:41.576004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:41.577007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:41.577328 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:41.591405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 HTTP/1.1 May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:48:41.593064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:48:41.594608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '8ce6ee7f-d1fd-4950-b2b2-6504004d5e01'} May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:48:41.595408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:48:41.596706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:41.598077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:48:41.598077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-607a6b2f-f28f-4f38-8ee6-57ce6a12c159 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 404 len: 111 microversion: 2.1 time: 0.030947 May 17 15:48:41.598077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 320/640] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:41 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:48:41.604166 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b9661e3e-2abd-472e-960a-f06d8d70f908 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '.version_select at 0x7f83f75c68b0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:41.607396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9661e3e-2abd-472e-960a-f06d8d70f908 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [76b78f40-b76a-44ef-847c-482519a8189e] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 15:48:42.614705 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9661e3e-2abd-472e-960a-f06d8d70f908 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [76b78f40-b76a-44ef-847c-482519a8189e] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 55154. May 17 15:48:42.633584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b9661e3e-2abd-472e-960a-f06d8d70f908 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379606882" status: 202 len: 0 microversion: 2.1 time: 1.033811 May 17 15:48:42.634190 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 321/641] 10.222.0.75 () {58 vars in 1220 bytes} [Tue May 17 15:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1379606882 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:48:43.494399 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d4f06808-bcbd-4a2e-926d-247bcf3dd3e9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: .version_select at 0x7f84005e2160>, body: {"keypair": {"name": "tempest-keypair-1675718945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwjW93EB4VMtRcmcPCxyWUSoI3rnqnXtytqYtOKvVRG0ondG1UZ4LA9DDk8lquscfo2AsvMeQhUzKNbMMIpoIaD/dvv7lmlXS8zMbtlpheaCRYjKwp3kx2o1tJjVLHJXg=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:43.508328 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-d4f06808-bcbd-4a2e-926d-247bcf3dd3e9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:48:43.511974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-d4f06808-bcbd-4a2e-926d-247bcf3dd3e9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:48:43.534989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d4f06808-bcbd-4a2e-926d-247bcf3dd3e9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044363 May 17 15:48:43.535599 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 321/642] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:48:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:44.725358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-828768994", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "670d118c-c4c6-4faf-9e34-d28bf36911ac"}], "security_groups": [{"name": "tempest-securitygroup--1145903585"}], "key_name": "tempest-keypair-1675718945", "user_data": "}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:44.826778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] validate_networks() for [('670d118c-c4c6-4faf-9e34-d28bf36911ac', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:48:45.217542 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:48:45.217970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:48:45.218478 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:48:45.218893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:48:45.219309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:48:45.233416 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:45.233866 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:45.234711 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:45.235149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:45.259048 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:48:45.262886 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:48:45.273459 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:48:45.275845 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:48:45.322676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-37eb355c-855c-4795-a1a0-63ba51e8997c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.602624 May 17 15:48:45.323356 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 322/643] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:48:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:48:45.333214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-eac8f77d-4b4d-4550-bad8-1bb530a8e1c0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:45.333841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-eac8f77d-4b4d-4550-bad8-1bb530a8e1c0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:45.387553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eac8f77d-4b4d-4550-bad8-1bb530a8e1c0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:45.393955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-eac8f77d-4b4d-4550-bad8-1bb530a8e1c0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1241 microversion: 2.1 time: 0.064617 May 17 15:48:45.394545 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 322/644] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:45 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:46.411175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:46.411711 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:46.417949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:46.418436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:46.419206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:46.419648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:46.494857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:46.504609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ea443002-a073-4819-a401-995ac287fe35 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1301 microversion: 2.1 time: 0.098266 May 17 15:48:46.505764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 323/645] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:46 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:47.315042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:47.315537 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:47.322053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.322518 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.323297 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.323761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.352761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9d41dc4b-9cd8-4754-a353-2ad11d8f3d12 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments/8c3cdcb2-39d4-4ff6-9e0d-578cc1132d8b" status: 200 len: 194 microversion: 2.20 time: 0.042148 May 17 15:48:47.353346 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 323/646] 10.222.0.75 () {60 vars in 1453 bytes} [Tue May 17 15:48:47 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments/8c3cdcb2-39d4-4ff6-9e0d-578cc1132d8b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:48:47.424405 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:47.425039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:47.431534 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.432064 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.432906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.433552 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.515547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lazy-loading 'services' on Instance uuid 4a13b9b5-8727-4b05-aa28-b74aad598788 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:48:47.522379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:47.523205 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:47.529173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.529627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.530450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.530885 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.587809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8f82dce6-b449-46a8-ad0e-6a24a7943c32 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments/8c3cdcb2-39d4-4ff6-9e0d-578cc1132d8b" status: 202 len: 0 microversion: 2.20 time: 0.175719 May 17 15:48:47.588428 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 324/647] 10.222.0.75 () {60 vars in 1456 bytes} [Tue May 17 15:48:47 2022] DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments/8c3cdcb2-39d4-4ff6-9e0d-578cc1132d8b => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 15:48:47.597895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:47.599479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:47.605770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.606261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.607113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.607567 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.640811 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f7cb6562-a4f6-47bc-92a2-4c63c6394081 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047875 May 17 15:48:47.641363 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 325/648] 10.222.0.75 () {60 vars in 1342 bytes} [Tue May 17 15:48:47 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 15:48:47.736303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:47.746988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1ac292cd-62ef-4049-93ea-5ce00d1c5456 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.228165 May 17 15:48:47.747788 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 324/649] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:47 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:48:47.939226 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-c2136c9e-8e86-407e-9d1a-a87a8df2bdda req-9f08f7f6-3b6b-43b0-9f39-6f503e0cb7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07336f08-accf-4aea-8682-5efa8f66d850", "tag": "b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:47.947159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-c2136c9e-8e86-407e-9d1a-a87a8df2bdda req-9f08f7f6-3b6b-43b0-9f39-6f503e0cb7f9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:47.947823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-c2136c9e-8e86-407e-9d1a-a87a8df2bdda req-9f08f7f6-3b6b-43b0-9f39-6f503e0cb7f9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:47.960000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-c2136c9e-8e86-407e-9d1a-a87a8df2bdda req-9f08f7f6-3b6b-43b0-9f39-6f503e0cb7f9 service nova] Creating event network-changed:b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f for instance 07336f08-accf-4aea-8682-5efa8f66d850 on hv-cinder-84212 May 17 15:48:47.965005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-c2136c9e-8e86-407e-9d1a-a87a8df2bdda req-9f08f7f6-3b6b-43b0-9f39-6f503e0cb7f9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029333 May 17 15:48:47.968300 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 326/650] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:48.652953 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:48.653975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:48.660822 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.661271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.662050 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.662505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.691837 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e963c37b-fb5f-4b95-98cd-6d7551d3a8ea tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042911 May 17 15:48:48.692393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 325/651] 10.222.0.75 () {60 vars in 1342 bytes} [Tue May 17 15:48:48 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:48.750288 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:48.750977 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:48.756996 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.757560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.758427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.759006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.763765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:48.764390 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:48.770729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.771190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.771976 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.772420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.787156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:48:48.866482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b0d9d95d-5306-4966-abc8-99c05df3f06e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 204 len: 0 microversion: 2.20 time: 0.120522 May 17 15:48:48.867293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 327/652] 10.222.0.75 () {60 vars in 1279 bytes} [Tue May 17 15:48:48 2022] DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 15:48:48.876375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:48.878184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:48.883800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.884247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:48.885015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:48.885465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:49.000729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:49.009592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1ffbd488-a9d2-49f0-b3a9-41dfd734dfc0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.249563 May 17 15:48:49.010197 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 326/653] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:48 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:48:49.071833 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:49.079623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:49.081122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:49.082307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-906152f1-752d-4c5d-b3d6-032b06a8c1bc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.210212 May 17 15:48:49.082869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 328/654] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:48 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:48:50.026139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:50.026784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:50.033053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:50.034242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:50.035017 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:50.035450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:50.101351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:50.101925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:50.108808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:50.109266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:50.110134 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:50.110580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:50.191587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:50.198870 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3611ad35-7d0e-4ce3-9bed-db1eeec52530 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.176659 May 17 15:48:50.199437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 327/655] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:50 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:50.253126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:50.260703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:50.262233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:50.263371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d93ab7b4-7804-4663-90f2-92d36e291867 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.165969 May 17 15:48:50.263920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 329/656] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:50 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:48:51.215926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:51.216542 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:51.222907 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:51.223359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:51.224136 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:51.224575 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:51.282046 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:51.282773 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:51.289266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:51.289810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:51.290616 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:51.291059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:51.404655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:51.412895 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7f643a85-f232-4a02-aa51-835db8d66aa3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.200767 May 17 15:48:51.413479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 328/657] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:51 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:51.438813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:51.451732 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:51.455983 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:51.457760 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-235da161-fdbf-4ef4-bfc6-333cc50b82e4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.179085 May 17 15:48:51.457760 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 330/658] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:51 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:48:52.430156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:52.430725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:52.437066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:52.437528 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:52.438329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:52.438774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:52.475576 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:52.476184 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:52.482940 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:52.483388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:52.484155 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:52.484591 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:52.619617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:52.627444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ae7d2fd3-9110-4f3f-bdf0-28a4a8fff0c7 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.200763 May 17 15:48:52.628012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 329/659] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:52 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:52.649048 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:52.656744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:52.658282 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:52.659428 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-be0c093e-9fcf-4131-90b4-ec6391cf2c0e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1721 microversion: 2.20 time: 0.187646 May 17 15:48:52.659977 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 331/660] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:52 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:48:53.644439 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:53.645300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:53.655583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:53.656053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:53.656855 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:53.657405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:53.681197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:53.682125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:53.707326 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:53.708000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:53.709207 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:53.709328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:53.813638 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:53.823823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:53.825540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:53.827764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4d0fd8f1-f4fe-4c96-b152-8d461ce3b4c7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 200 len: 1365 microversion: 2.20 time: 0.151022 May 17 15:48:53.829006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 332/661] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:53 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:48:53.836120 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-ffa7a114-9c6f-449a-9ba4-fa47784e4c73 req-66ea112a-a4b5-4eec-b5f5-d8510ae67a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a13b9b5-8727-4b05-aa28-b74aad598788", "name": "network-vif-deleted", "tag": "d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:53.846297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ffa7a114-9c6f-449a-9ba4-fa47784e4c73 req-66ea112a-a4b5-4eec-b5f5-d8510ae67a50 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:53.846752 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ffa7a114-9c6f-449a-9ba4-fa47784e4c73 req-66ea112a-a4b5-4eec-b5f5-d8510ae67a50 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:53.863700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:53.867120 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-ffa7a114-9c6f-449a-9ba4-fa47784e4c73 req-66ea112a-a4b5-4eec-b5f5-d8510ae67a50 service nova] Creating event network-vif-deleted:d1a27eb9-04bf-4a1b-93dc-64e1a3dad03e for instance 4a13b9b5-8727-4b05-aa28-b74aad598788 on hv-cinder-84212 May 17 15:48:53.875447 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2f62e00c-e1ab-4b56-8072-c0446bea4ed8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.235072 May 17 15:48:53.876130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 330/662] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:53 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:53.878361 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-ffa7a114-9c6f-449a-9ba4-fa47784e4c73 req-66ea112a-a4b5-4eec-b5f5-d8510ae67a50 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047617 May 17 15:48:53.879301 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 333/663] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:54.847258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:54.847947 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:54.854714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:54.855161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:54.855938 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:54.856380 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:54.878929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] HTTP exception thrown: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Request method failure captured: May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 HTTP/1.1 May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JJPQeMA1X4bO8ewBLTH9oUm01TYSF-Lve0S2NmVv30G36JR8lifLj_Kz6jWYwzY-sMvIHSfN8qdwPUhyyyhYRtsWXqOz0A0LIhJ3ZBTSFm2Vor508lrSjti2SrSrK5gNJna3JY8XiDpHhooJo1hPpy4DnIa1C4-hU9LELvH-k29XM May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Openstack-Nova-Api-Version: 2.20 May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: bf36f753be81486182665056a949849c May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:48:54.880707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bf36f753be81486182665056a949849c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bf36f753be81486182665056a949849c"}]}] May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: bf36f753be81486182665056a949849c May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 2e4972b781b043f69740342fde4efa73 May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:48:54.882340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '4a13b9b5-8727-4b05-aa28-b74aad598788'} May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:48:54.886164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:48:54.887812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:48:54.888954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Returning 404 to user: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:48:54.888954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d976ead6-f49b-4c3e-b696-bb95f0d8cb36 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 404 len: 111 microversion: 2.20 time: 0.039324 May 17 15:48:54.888954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 331/664] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:54 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 15:48:54.892960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:54.893417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c4c9bdde-5017-4151-b132-e34b144ad050 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '.version_select at 0x7f840059e1f0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:54.893681 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:54.900625 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:54.901277 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:54.902095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:54.902891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:54.913030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c4c9bdde-5017-4151-b132-e34b144ad050 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696945681" status: 204 len: 0 microversion: 2.20 time: 0.023748 May 17 15:48:54.913680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 332/665] 10.222.0.75 () {60 vars in 1258 bytes} [Tue May 17 15:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696945681 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 15:48:55.088601 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:55.096645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-99995bf3-39f9-400d-aa9d-21a491f63825 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.208168 May 17 15:48:55.097254 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 334/666] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:54 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:55.606996 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-da3540a4-5bfb-46e7-b1d8-7134608eefbd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'create', calling method: .version_select at 0x7f83f74ba160>, body: {"keypair": {"name": "tempest-keypair-1034974637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnWyEMG6kJmJEJyo9PjU+rP6OmIpD3EFwJjfhrjicMQ1UMwciUWRSRGBwVTSPFEN8A39LBuFW4I+ydYh7BNOUIA8RnVTl8Penkcp8Vik8FyvR4wPsXQBIaou4d6uw/0IA=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:55.621160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-da3540a4-5bfb-46e7-b1d8-7134608eefbd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for project bf36f753be81486182665056a949849c. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:48:55.624833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-da3540a4-5bfb-46e7-b1d8-7134608eefbd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for user 2e4972b781b043f69740342fde4efa73 and project bf36f753be81486182665056a949849c. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:48:55.646746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-da3540a4-5bfb-46e7-b1d8-7134608eefbd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043601 May 17 15:48:55.647334 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 333/667] 10.222.0.75 () {62 vars in 1199 bytes} [Tue May 17 15:48:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 15:48:55.926257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-270a49e4-9091-44be-b55c-449d1418850e req-290b94fb-23d3-43b8-8634-276ba8609957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07336f08-accf-4aea-8682-5efa8f66d850", "name": "network-vif-plugged", "status": "completed", "tag": "b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:55.935248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-270a49e4-9091-44be-b55c-449d1418850e req-290b94fb-23d3-43b8-8634-276ba8609957 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:55.935815 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-270a49e4-9091-44be-b55c-449d1418850e req-290b94fb-23d3-43b8-8634-276ba8609957 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:55.948032 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-270a49e4-9091-44be-b55c-449d1418850e req-290b94fb-23d3-43b8-8634-276ba8609957 service nova] Creating event network-vif-plugged:b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f for instance 07336f08-accf-4aea-8682-5efa8f66d850 on hv-cinder-84212 May 17 15:48:55.955546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-270a49e4-9091-44be-b55c-449d1418850e req-290b94fb-23d3-43b8-8634-276ba8609957 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099573 May 17 15:48:55.955546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 335/668] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:56.113824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:56.114581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:56.120635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:56.121123 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:56.121985 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:56.122521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:56.367996 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:56.375505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d325820c-3c81-48cd-9e6b-311faca6083e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.266480 May 17 15:48:56.376076 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 334/669] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:56 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:57.000092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-50963858", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16bc5678-13ce-4abe-8c13-1d4cfd08569f"}], "security_groups": [{"name": "tempest-securitygroup--1230516929"}], "key_name": "tempest-keypair-1034974637", "user_data": "}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:57.098078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] validate_networks() for [('16bc5678-13ce-4abe-8c13-1d4cfd08569f', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:48:57.392234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:57.393032 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:57.399065 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:57.399454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:57.400230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:57.400661 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:57.480604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:48:57.481033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:48:57.481513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:48:57.481933 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:48:57.482481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:48:57.491162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:57.491613 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:57.492426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:57.492862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:57.513535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for project bf36f753be81486182665056a949849c. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:48:57.518333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Getting quotas for user 2e4972b781b043f69740342fde4efa73 and project bf36f753be81486182665056a949849c. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:48:57.529391 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:48:57.531802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:48:57.542344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:57.549721 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-00d81353-c2d9-47f9-9239-1c40a0b1afb8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1367 microversion: 2.1 time: 0.161292 May 17 15:48:57.550314 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 335/670] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:57 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:48:57.581039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e1609ea1-4e8e-4755-a28f-9cf824e29fc5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.585527 May 17 15:48:57.581687 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 336/671] 10.222.0.75 () {62 vars in 1187 bytes} [Tue May 17 15:48:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 15:48:57.591545 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e5ad9b50-697d-44ce-b094-3fde244b3c17 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:57.592166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e5ad9b50-697d-44ce-b094-3fde244b3c17 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:57.649254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e5ad9b50-697d-44ce-b094-3fde244b3c17 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:57.656238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e5ad9b50-697d-44ce-b094-3fde244b3c17 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:57.657729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e5ad9b50-697d-44ce-b094-3fde244b3c17 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:57.659449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e5ad9b50-697d-44ce-b094-3fde244b3c17 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1280 microversion: 2.20 time: 0.071724 May 17 15:48:57.660004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 336/672] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:57 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:48:58.566389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:58.566909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:58.574198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:58.574656 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:58.575430 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:58.575873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:58.677839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:58.678484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:58.685516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:58.686271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:58.687302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:58.687746 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:58.779429 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:58.794423 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:58.795942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:58.797056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-24a24825-057a-46f8-8e09-838bed4195fc tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1340 microversion: 2.20 time: 0.123142 May 17 15:48:58.797604 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 337/673] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:58 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1340 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:48:58.830673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:48:58.838331 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-82cceb5f-89a9-45c5-ba5d-f917fdb763f9 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1557 microversion: 2.1 time: 0.275917 May 17 15:48:58.838899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 337/674] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:48:58 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1557 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:48:58.854694 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:58.855198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:58.861795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:58.862452 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:58.863239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:58.863698 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:58.941053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-74316c6c-75a8-4d3e-ba2d-f7ecf0b5d1d0 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090522 May 17 15:48:58.941640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 338/675] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:48:58 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:48:59.815548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:48:59.816362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:48:59.823090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:59.823658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:59.824564 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:59.825106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:59.967410 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-ca1579dd-b802-405a-861a-15604994f540 req-4982cfa4-2c72-4055-9fff-dde45aaeccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07336f08-accf-4aea-8682-5efa8f66d850", "tag": "b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:48:59.981601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ca1579dd-b802-405a-861a-15604994f540 req-4982cfa4-2c72-4055-9fff-dde45aaeccc9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:48:59.982243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ca1579dd-b802-405a-861a-15604994f540 req-4982cfa4-2c72-4055-9fff-dde45aaeccc9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:48:59.999994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-ca1579dd-b802-405a-861a-15604994f540 req-4982cfa4-2c72-4055-9fff-dde45aaeccc9 service nova] Creating event network-changed:b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f for instance 07336f08-accf-4aea-8682-5efa8f66d850 on hv-cinder-84212 May 17 15:49:00.006289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-ca1579dd-b802-405a-861a-15604994f540 req-4982cfa4-2c72-4055-9fff-dde45aaeccc9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102840 May 17 15:49:00.006894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 339/676] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:49:00.306868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:00.315727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:00.317597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:00.318997 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e827d50e-3bf3-42e0-912f-fc7b72d7fbbe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.507941 May 17 15:49:00.319680 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 338/677] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:48:59 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:00.904545 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-de69935e-b5a5-4a7c-8a86-4b52ee2dff37 req-1ad532bb-feb4-400a-8f96-7f54588d3244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:00.918758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-de69935e-b5a5-4a7c-8a86-4b52ee2dff37 req-1ad532bb-feb4-400a-8f96-7f54588d3244 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:00.919203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-de69935e-b5a5-4a7c-8a86-4b52ee2dff37 req-1ad532bb-feb4-400a-8f96-7f54588d3244 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:00.946399 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-de69935e-b5a5-4a7c-8a86-4b52ee2dff37 req-1ad532bb-feb4-400a-8f96-7f54588d3244 service nova] Creating event network-changed:3147fce3-6722-4f48-9760-c37ce1f654e6 for instance 0748c249-ac72-4f86-956e-d02cac507f75 on hv-cinder-84212 May 17 15:49:00.964695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-de69935e-b5a5-4a7c-8a86-4b52ee2dff37 req-1ad532bb-feb4-400a-8f96-7f54588d3244 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064995 May 17 15:49:00.967332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 340/678] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:01.336880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:01.338020 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:01.345251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:01.346284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:01.347784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:01.348393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:01.637463 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:01.645779 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:01.647291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:01.648412 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f0838213-d06c-43dc-84de-66ee38a56cf1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.315469 May 17 15:49:01.648975 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 339/679] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:01 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:02.667494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:02.668205 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:02.682298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:02.682751 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:02.683532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:02.684331 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:02.810438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:02.818699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:02.820196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:02.821287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c0de5b0d-10d3-43c2-8042-a91492806ae7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.158346 May 17 15:49:02.821835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 341/680] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:02 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:03.839797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:03.840333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:03.846620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:03.847068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:03.847829 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:03.848262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:03.974295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:03.982289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:03.983789 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:03.984877 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7ebcaf98-ccfd-4497-8b6d-1843e3849133 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.149043 May 17 15:49:03.985437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 340/681] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:03 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:05.002803 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:05.003247 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:05.009339 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:05.009798 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:05.010615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:05.011060 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:05.204752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:05.216522 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:05.218288 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:05.219467 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-22e591cd-9ed2-4022-894f-b76506a8c31e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.220914 May 17 15:49:05.220041 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 342/682] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:04 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:06.237695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:06.238959 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:06.245088 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:06.245533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:06.246315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:06.246750 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:06.403218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:06.411821 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:06.413314 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:06.414441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1075a856-42e7-489e-bcda-a9fc938fa823 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.180603 May 17 15:49:06.414998 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 341/683] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:06 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:07.432421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:07.432952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:07.439299 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:07.439754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:07.440521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:07.442742 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:07.572727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:07.580534 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:07.582101 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:07.583203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ddc392b7-7d89-48ce-b230-351d9f682770 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.154742 May 17 15:49:07.583763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 343/684] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:07 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:07.919218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a44d7b9f-c2e2-49c8-9a2b-e2f12dd8af78 req-1711d957-eb00-4992-b74f-c9d4152e638d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "name": "network-vif-plugged", "status": "completed", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:07.928920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a44d7b9f-c2e2-49c8-9a2b-e2f12dd8af78 req-1711d957-eb00-4992-b74f-c9d4152e638d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:07.929492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a44d7b9f-c2e2-49c8-9a2b-e2f12dd8af78 req-1711d957-eb00-4992-b74f-c9d4152e638d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:07.941463 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a44d7b9f-c2e2-49c8-9a2b-e2f12dd8af78 req-1711d957-eb00-4992-b74f-c9d4152e638d service nova] Creating event network-vif-plugged:3147fce3-6722-4f48-9760-c37ce1f654e6 for instance 0748c249-ac72-4f86-956e-d02cac507f75 on hv-cinder-84212 May 17 15:49:07.946749 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-a44d7b9f-c2e2-49c8-9a2b-e2f12dd8af78 req-1711d957-eb00-4992-b74f-c9d4152e638d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031004 May 17 15:49:07.947344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 342/685] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:49:08.041855 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:08.042343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:08.048305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:08.048755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:08.049527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:08.049961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:08.072466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lazy-loading 'flavor' on Instance uuid c0c47a31-9dc4-459c-aa92-3f64baacafd5 {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:49:08.147660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-07dc6830-d904-470c-896d-69a4d24cfc97 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "POST /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5/action" status: 202 len: 0 microversion: 2.1 time: 0.109514 May 17 15:49:08.148290 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 344/686] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:49:08 2022] POST /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 15:49:08.157938 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:08.158799 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:08.165449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:08.165984 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:08.166830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:08.167273 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:08.299622 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:08.307636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b6576035-33ab-42aa-8ccd-88e59dcb5364 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.154735 May 17 15:49:08.308237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 343/687] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:08 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:08.602698 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:08.603392 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:08.609916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:08.610469 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:08.611305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:08.611749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:08.746394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:08.754766 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:08.756265 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:08.757357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6a99a886-90d6-4d53-84c2-f66c3f3b9d6b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1406 microversion: 2.20 time: 0.160440 May 17 15:49:08.757914 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 345/688] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:08 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:49:09.324652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:09.325266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:09.331708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:09.332162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:09.332928 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:09.333365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:09.458204 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:09.469344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8fbbc20d-508c-41c3-bcb9-1690021dd56a tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.148566 May 17 15:49:09.469912 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 344/689] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:09 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:09.775837 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:09.776555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:09.783125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:09.783886 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:09.785299 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:09.785740 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:09.916727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:09.924475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:09.925981 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:09.927150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-23b2dbcd-4e23-446d-af00-9980dad94b7e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1598 microversion: 2.20 time: 0.155464 May 17 15:49:09.927704 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 346/690] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:49:09 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:49:09.944364 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:09.944861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:09.950642 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:09.951089 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:09.951849 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:09.952284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:10.027633 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a14af4e3-6c77-404d-92ca-8aab020fa6a5 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086998 May 17 15:49:10.028200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 345/691] 10.222.0.75 () {60 vars in 1315 bytes} [Tue May 17 15:49:09 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 15:49:10.487304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:10.488081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:10.493903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:10.494406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:10.495176 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:10.495620 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:10.699012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:10.706535 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d20caa37-a65a-4dec-8c17-da5759a9d4ad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.223139 May 17 15:49:10.707103 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 347/692] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:10 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:11.269971 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a948d4d1-6f2e-46c9-b721-a2d6959ebeff req-a9563f59-a201-44e8-b6b6-5e8ffe61d67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:11.277883 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a948d4d1-6f2e-46c9-b721-a2d6959ebeff req-a9563f59-a201-44e8-b6b6-5e8ffe61d67d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:11.278353 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a948d4d1-6f2e-46c9-b721-a2d6959ebeff req-a9563f59-a201-44e8-b6b6-5e8ffe61d67d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:11.289817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a948d4d1-6f2e-46c9-b721-a2d6959ebeff req-a9563f59-a201-44e8-b6b6-5e8ffe61d67d service nova] Creating event network-changed:3147fce3-6722-4f48-9760-c37ce1f654e6 for instance 0748c249-ac72-4f86-956e-d02cac507f75 on hv-cinder-84212 May 17 15:49:11.294618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-a948d4d1-6f2e-46c9-b721-a2d6959ebeff req-a9563f59-a201-44e8-b6b6-5e8ffe61d67d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028746 May 17 15:49:11.295256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 346/693] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:11.723772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:11.724905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:11.732066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:11.732524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:11.733461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:11.733905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:11.908644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:11.917830 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-01f91cef-76de-47a8-84ee-0ff668d16de3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.198834 May 17 15:49:11.918434 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 348/694] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:11 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:12.936819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:12.937547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:12.943708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:12.944156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:12.944918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:12.945356 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:13.074293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:13.081702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-542b3faa-8a3e-454f-ae18-998062b1bdb0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.149510 May 17 15:49:13.082315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 347/695] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:12 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:14.098395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:14.099046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:14.105630 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:14.106116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:14.106918 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:14.107363 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:14.241565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:14.248994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9f8a4071-7b90-4a4c-a624-cce80b174955 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.155006 May 17 15:49:14.249561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 349/696] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:14 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:15.266521 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:15.267062 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:15.273766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:15.274245 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:15.275000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:15.275428 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:15.404257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:15.412204 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0a9017e6-9f84-4146-8f04-9a560cdc4701 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.149524 May 17 15:49:15.412767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 348/697] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:15 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:16.429919 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:16.430479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:16.436900 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:16.437357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:16.438172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:16.438609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:16.565951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:16.573245 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0286dec7-2406-4162-abba-b45a0bf1c555 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.147288 May 17 15:49:16.573805 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 350/698] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:16 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:16.989663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:16.990171 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:16.996433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:16.996911 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:16.997673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:16.998157 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:17.075144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'services' on Instance uuid 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:49:17.147031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7c4bd1c1-c663-40a7-aa15-c52752685aec tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments/1e037f7e-262d-4756-b547-33edaaff6a9e" status: 202 len: 0 microversion: 2.1 time: 0.160895 May 17 15:49:17.147396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 349/699] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:49:16 2022] DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments/1e037f7e-262d-4756-b547-33edaaff6a9e => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:49:17.155686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:17.156664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:17.162795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:17.163241 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:17.164007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:17.164473 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:17.193599 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-43f1aaed-0bae-40b5-a041-01adafa15f47 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 May 17 15:49:17.194170 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 351/700] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:49:17 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:17.591926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:17.592537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:17.599285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:17.599734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:17.600491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:17.600924 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:17.734197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:17.745087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-77a40d05-f23e-458a-84d1-899639ec5080 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.157284 May 17 15:49:17.745764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 350/701] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:17 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:18.205537 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:18.206996 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:18.213218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.213666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.214449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.214880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.246026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-163430a4-49c5-40dc-b394-1bb54d9aabab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044353 May 17 15:49:18.246579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 352/702] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:49:18 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:49:18.316892 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:18.317395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:18.323890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.324362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.325134 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.325616 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.353200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:49:18.425482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-944db307-f8b2-4cbd-902f-6329714da66f tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 204 len: 0 microversion: 2.1 time: 0.112049 May 17 15:49:18.426190 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 351/703] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:49:18 2022] DELETE /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:49:18.433809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:18.434516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:18.440785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.441233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.442013 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.442583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.571400 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:18.578734 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bf534db8-6c49-41ba-8c54-34e325f2b946 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1688 microversion: 2.1 time: 0.148690 May 17 15:49:18.579302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 353/704] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:18 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:18.763334 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:18.764025 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:18.769983 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.770455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.771229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:18.771658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:18.911722 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:18.919029 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-26936688-f18b-4289-869a-8dab1d0f2bc3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.159865 May 17 15:49:18.919594 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 352/705] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:18 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:19.596012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:19.596592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:19.603780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:19.604230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:19.604994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:19.605430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:19.734332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:19.742664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a5401627-68a1-45ee-a513-4851ebc804d0 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1688 microversion: 2.1 time: 0.150559 May 17 15:49:19.743318 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 354/706] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:19 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:19.939548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:19.940396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:19.946821 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:19.947272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:19.948035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:19.948473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:20.078187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:20.086227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b272d027-cec1-4c37-86a6-b5857bb06f57 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.153140 May 17 15:49:20.086882 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 353/707] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:19 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:20.762244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:20.762886 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:20.769806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:20.770282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:20.771043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:20.771479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:20.900618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:20.907932 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0ec60a54-8f39-4703-8909-e29ac990ff41 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1688 microversion: 2.1 time: 0.149552 May 17 15:49:20.908508 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 355/708] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:20 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:21.103753 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:21.104284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:21.110583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:21.111031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:21.111791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:21.112731 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:21.246033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:21.253978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-86725106-1a2b-435e-813e-be1684a7e0a4 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.154349 May 17 15:49:21.254571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 354/709] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:21 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:21.924721 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:21.925339 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:21.931771 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:21.932227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:21.933066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:21.933510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:22.098250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:22.105853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2b7a8bc4-9a7f-42cb-a95e-cf79d205971c tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1688 microversion: 2.1 time: 0.185076 May 17 15:49:22.106468 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 356/710] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:21 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:22.271728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:22.272365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:22.279138 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:22.279597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:22.280380 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:22.280863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:22.566297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:22.573571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f95e72fa-d031-416f-a8e6-0563ca254ab0 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.306202 May 17 15:49:22.574173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 355/711] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:22 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:23.123227 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:23.123944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:23.130538 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:23.131034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:23.131818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:23.132271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:23.198702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:23.208526 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f2fc9e2c-56de-43b8-8e18-956a92b74b18 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1621 microversion: 2.1 time: 0.089102 May 17 15:49:23.209109 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 357/712] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:23 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1621 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:23.250479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-e64db2da-4c5d-4aff-9b53-4e543b9400f9 req-75f1aad6-85ab-42cf-b844-944033a1df35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9d0cdd-63f7-4a69-900b-583bbb9a11f3", "name": "network-vif-deleted", "tag": "58496923-8c39-489f-ae0c-a030f0c47bcc"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:23.258450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e64db2da-4c5d-4aff-9b53-4e543b9400f9 req-75f1aad6-85ab-42cf-b844-944033a1df35 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:23.258979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e64db2da-4c5d-4aff-9b53-4e543b9400f9 req-75f1aad6-85ab-42cf-b844-944033a1df35 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:23.269767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-e64db2da-4c5d-4aff-9b53-4e543b9400f9 req-75f1aad6-85ab-42cf-b844-944033a1df35 service nova] Creating event network-vif-deleted:58496923-8c39-489f-ae0c-a030f0c47bcc for instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 on hv-cinder-84212 May 17 15:49:23.274796 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-e64db2da-4c5d-4aff-9b53-4e543b9400f9 req-75f1aad6-85ab-42cf-b844-944033a1df35 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027984 May 17 15:49:23.275391 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 356/713] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:23.590987 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:23.591497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:23.598344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:23.598813 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:23.599605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:23.600050 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:23.741055 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:23.749044 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-75e4a6d8-d1c3-48d4-b2f0-4579f1b60876 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.161966 May 17 15:49:23.749637 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 358/714] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:23 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:24.225478 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:24.226291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:24.233694 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.235263 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:24.236281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.237469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:24.271249 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.271703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:24.272162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'fault' on Instance uuid 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:49:24.327162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:24.338043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5d469ff6-c57e-4c23-b421-1ebaa768dc37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 200 len: 1335 microversion: 2.1 time: 0.116864 May 17 15:49:24.339439 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 357/715] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:24 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:24.766832 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:24.767454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:24.774452 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.774910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:24.775683 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.776128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:24.907271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:24.914608 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b94f908a-cff0-43c5-b169-bcbecd7002df tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1569 microversion: 2.1 time: 0.151698 May 17 15:49:24.915188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 359/716] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:24 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:24.931341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:24.931921 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:24.938910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.939128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:24.939915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:24.941021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:25.017609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a14b8c18-a555-4f54-ba3d-df795eaccd50 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "POST /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5/action" status: 202 len: 0 microversion: 2.1 time: 0.090102 May 17 15:49:25.018621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 358/717] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:49:24 2022] POST /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:49:25.027941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:25.028561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:25.034888 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:25.035340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:25.036114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:25.036550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:25.167834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:25.175885 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5728bc45-b772-47a6-b0f7-df09c84339d2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1517 microversion: 2.1 time: 0.152539 May 17 15:49:25.176454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 360/718] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:25 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:25.356365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:25.357124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:25.363753 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:25.364295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:25.365177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:25.365691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:25.380648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] HTTP exception thrown: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 could not be found. May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Request method failure captured: May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 HTTP/1.1 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JLQwW9F_iSrYfsCSJcOyPs6IDUbEVekJsZBZzSip5wVBdO0j7saQv47K7fwvjQSCAfcSJEBbJlBoWtJ1z7eRDag5jZnAgLohF_IEC6l9EDycghetO2wwQyuvcubo5CbCdJ3XvER5o6CMPuZvZ9FIclMk_5_eFR2-IzClgfM_RUI_8 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:49:25.382471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/87cc0cd3d0df4dccbc28058b6866d076"}]}] May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: b40c7b11fff443fa8c78e8647703e230 May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 could not be found. May 17 15:49:25.384068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '5c9d0cdd-63f7-4a69-900b-583bbb9a11f3'} May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 could not be found. May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:25.384963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 could not be found. May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 could not be found. May 17 15:49:25.386586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:25.387805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Returning 404 to user: Instance 5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:25.387805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5282d17b-f43e-43de-ba56-054bd5d99880 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3" status: 404 len: 111 microversion: 2.1 time: 0.032192 May 17 15:49:25.387805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 359/719] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:25 2022] GET /compute/v2.1/servers/5c9d0cdd-63f7-4a69-900b-583bbb9a11f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:49:25.392510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-687ff72e-1c4b-4bb7-8aab-8a4da6964cdb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '.version_select at 0x7f83fc83dd30>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:25.409866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-687ff72e-1c4b-4bb7-8aab-8a4da6964cdb tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267602904" status: 202 len: 0 microversion: 2.1 time: 0.020401 May 17 15:49:25.410703 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 361/720] 10.222.0.75 () {58 vars in 1220 bytes} [Tue May 17 15:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267602904 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:49:26.193077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:26.193712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:26.199823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:26.200269 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:26.201139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:26.201538 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:26.339327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:26.346728 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-92df0b07-033d-4e39-a147-d4fd656c5e05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1519 microversion: 2.1 time: 0.157958 May 17 15:49:26.347532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 360/721] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:26 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:27.367001 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:27.367614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:27.373441 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:27.373896 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:27.374705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:27.375151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:27.502045 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:27.510042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-22a67201-4b26-4674-a6bc-e7bc2aa7a355 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.147082 May 17 15:49:27.510621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 362/722] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:27 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:28.011902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-7480e12a-bdf1-4c45-9166-cab6d46576d7 req-8da1b2c1-8fcd-48c4-a6df-e13501a09203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "name": "network-vif-unplugged", "status": "completed", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:28.020785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-7480e12a-bdf1-4c45-9166-cab6d46576d7 req-8da1b2c1-8fcd-48c4-a6df-e13501a09203 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.021230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-7480e12a-bdf1-4c45-9166-cab6d46576d7 req-8da1b2c1-8fcd-48c4-a6df-e13501a09203 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.032092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-7480e12a-bdf1-4c45-9166-cab6d46576d7 req-8da1b2c1-8fcd-48c4-a6df-e13501a09203 service nova] Creating event network-vif-unplugged:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:49:28.037460 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-7480e12a-bdf1-4c45-9166-cab6d46576d7 req-8da1b2c1-8fcd-48c4-a6df-e13501a09203 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029317 May 17 15:49:28.038066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 361/723] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:28.282204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:28.282703 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:28.289066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.289515 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.290309 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.290744 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.315379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:49:28.390167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-62e0a2a0-21bf-4e11-aa60-87c0d669e762 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "DELETE /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 204 len: 0 microversion: 2.1 time: 0.111406 May 17 15:49:28.390838 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 363/724] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:49:28 2022] DELETE /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:49:28.399466 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:28.400201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:28.406611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.407080 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.407835 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.408274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.528625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:28.529344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:28.535402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.535854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.536662 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:28.537106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:28.540774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:28.548159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cfafb363-fabb-41d0-8b75-319191a4d9f7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1508 microversion: 2.1 time: 0.152915 May 17 15:49:28.548734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 362/725] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:28 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:28.663699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:28.671404 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-eca864ec-8d29-4bfd-acfb-993098832abb tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.147249 May 17 15:49:28.671983 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 364/726] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:28 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:29.427567 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-e5d97dec-24fa-487b-8083-cf51d83e574a req-2ea184db-9a4c-4d8d-8fe2-cf86f29d9687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73cc19bf-e9b1-4087-bffb-757df05d29e5", "name": "network-vif-deleted", "tag": "d88db692-f314-4035-ad7b-ca49d3a51b36"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:29.436811 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e5d97dec-24fa-487b-8083-cf51d83e574a req-2ea184db-9a4c-4d8d-8fe2-cf86f29d9687 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:29.437613 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e5d97dec-24fa-487b-8083-cf51d83e574a req-2ea184db-9a4c-4d8d-8fe2-cf86f29d9687 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:29.450697 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-e5d97dec-24fa-487b-8083-cf51d83e574a req-2ea184db-9a4c-4d8d-8fe2-cf86f29d9687 service nova] Creating event network-vif-deleted:d88db692-f314-4035-ad7b-ca49d3a51b36 for instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 on hv-cinder-84212 May 17 15:49:29.456043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-e5d97dec-24fa-487b-8083-cf51d83e574a req-2ea184db-9a4c-4d8d-8fe2-cf86f29d9687 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032620 May 17 15:49:29.456835 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 363/727] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:29.564567 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:29.565859 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:29.572389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:29.572854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:29.573635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:29.574113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:29.604235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:29.604629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:29.605081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'fault' on Instance uuid 73cc19bf-e9b1-4087-bffb-757df05d29e5 {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:49:29.647743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:29.655665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6c864cc1-3210-4f0c-808c-44887583ffe7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 200 len: 1312 microversion: 2.1 time: 0.094973 May 17 15:49:29.656242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 365/728] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:29 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:29.689485 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:29.691220 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:29.698884 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:29.699333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:29.700110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:29.700543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:29.852778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:29.860212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f11ed23b-486d-43c6-8b6a-72c24f79507e tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.175032 May 17 15:49:29.860795 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 364/729] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:29 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:30.677336 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:30.677949 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 73cc19bf-e9b1-4087-bffb-757df05d29e5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:30.684326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.684777 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.685539 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.685973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.699430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] HTTP exception thrown: Instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 could not be found. May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Request method failure captured: May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 HTTP/1.1 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JLQwW9F_iSrYfsCSJcOyPs6IDUbEVekJsZBZzSip5wVBdO0j7saQv47K7fwvjQSCAfcSJEBbJlBoWtJ1z7eRDag5jZnAgLohF_IEC6l9EDycghetO2wwQyuvcubo5CbCdJ3XvER5o6CMPuZvZ9FIclMk_5_eFR2-IzClgfM_RUI_8 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:49:30.701026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/87cc0cd3d0df4dccbc28058b6866d076"}]}] May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: b40c7b11fff443fa8c78e8647703e230 May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 could not be found. May 17 15:49:30.702626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '73cc19bf-e9b1-4087-bffb-757df05d29e5'} May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 could not be found. May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:30.703682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 could not be found. May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 could not be found. May 17 15:49:30.705149 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:30.707421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Returning 404 to user: Instance 73cc19bf-e9b1-4087-bffb-757df05d29e5 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:30.707421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2debef9b-16c7-44f8-9215-69564de351ab tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5" status: 404 len: 111 microversion: 2.1 time: 0.028860 May 17 15:49:30.707421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 366/730] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:30 2022] GET /compute/v2.1/servers/73cc19bf-e9b1-4087-bffb-757df05d29e5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:49:30.711510 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:30.712007 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:30.718313 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.718762 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.719533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.719972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.747007 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:49:30.818220 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cfd5f5af-1777-4cb1-aa14-06dbe5993a37 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 204 len: 0 microversion: 2.1 time: 0.110146 May 17 15:49:30.818863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 365/731] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:49:30 2022] DELETE /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:49:30.826921 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:30.827615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:30.834043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.834506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.835285 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.835733 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.879209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:30.880010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:30.885823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.886299 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:30.887069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:30.887501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:31.010847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:31.018262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f85187f5-4c92-420e-b258-aa07db998b04 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.195090 May 17 15:49:31.018833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 367/732] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:30 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:31.046416 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:31.054200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f0d8138e-bbe3-43d6-ae09-40209185ddc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.179817 May 17 15:49:31.054755 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 366/733] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:30 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:32.035119 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:32.035839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:32.042218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:32.042665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:32.043428 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:32.043860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:32.070661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:32.071270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:32.077662 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:32.078156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:32.078929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:32.079362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:32.225051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:32.233167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9054c710-d2b5-4b88-831f-ac2f085b1dc7 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.201854 May 17 15:49:32.233775 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 368/734] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:32 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:32.249665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:32.257620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d5958ac4-4123-4995-8f46-bd4357171f05 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.190721 May 17 15:49:32.258207 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 367/735] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:32 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:33.250430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:33.251042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:33.257388 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:33.257843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:33.258645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:33.259087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:33.274682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:33.275427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:33.281669 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:33.282149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:33.282915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:33.283346 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:33.486141 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:33.490580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:33.493723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-783e86f7-b160-4c4f-9a59-7f1dcab4e1e2 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.247035 May 17 15:49:33.494535 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 369/736] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:33 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:33.498051 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-68997472-bfd4-4f25-b97d-6162d5cf10b1 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.227050 May 17 15:49:33.498619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 368/737] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:33 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:34.512216 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:34.513586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:34.515757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:34.516894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:34.523242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:34.523818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:34.524392 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:34.524846 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:34.525244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:34.525626 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:34.525812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:34.526091 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:35.141689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:35.151128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-18ecb43b-5998-4d5a-9a21-c158538234c8 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1522 microversion: 2.1 time: 0.643395 May 17 15:49:35.151712 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 370/738] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:34 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:35.153061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:35.161047 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0f597e7d-3ca8-445e-9a90-6ccf493a2e62 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.649444 May 17 15:49:35.161814 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 369/739] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:34 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:35.298278 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-7d30afb4-9ee9-4a18-b8d0-bc22d9888fb2 req-f184753b-c1ee-451b-90ae-5e9ece4f149d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e592f5a-3f22-48bd-b517-5ddd4d5c2503", "name": "network-vif-deleted", "tag": "41b61a96-78fb-4784-84f7-a1553b8a3cee"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:35.307159 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-7d30afb4-9ee9-4a18-b8d0-bc22d9888fb2 req-f184753b-c1ee-451b-90ae-5e9ece4f149d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:35.307731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-7d30afb4-9ee9-4a18-b8d0-bc22d9888fb2 req-f184753b-c1ee-451b-90ae-5e9ece4f149d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:35.321767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-7d30afb4-9ee9-4a18-b8d0-bc22d9888fb2 req-f184753b-c1ee-451b-90ae-5e9ece4f149d service nova] Creating event network-vif-deleted:41b61a96-78fb-4784-84f7-a1553b8a3cee for instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 on hv-cinder-84212 May 17 15:49:35.327032 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-7d30afb4-9ee9-4a18-b8d0-bc22d9888fb2 req-f184753b-c1ee-451b-90ae-5e9ece4f149d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032498 May 17 15:49:35.327658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 371/740] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:36.168502 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:36.169114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:36.176047 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:36.176506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:36.177260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:36.177689 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:36.179146 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:36.179884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:36.186479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:36.186856 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:36.187631 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:36.188076 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:36.208855 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:36.209300 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:36.209858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lazy-loading 'fault' on Instance uuid 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:49:36.276872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40c7b11fff443fa8c78e8647703e230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87cc0cd3d0df4dccbc28058b6866d076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:36.285281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-03d7dd28-9d75-4345-988d-a69a45370781 tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 200 len: 1311 microversion: 2.1 time: 0.119867 May 17 15:49:36.285281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 370/741] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:36 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:36.352598 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:36.359997 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-043db75d-e08f-4cf7-ac41-4ec0b7f00dad tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1575 microversion: 2.1 time: 0.185032 May 17 15:49:36.360563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 372/742] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:36 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:49:37.300553 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:37.301155 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] [instance: 1e592f5a-3f22-48bd-b517-5ddd4d5c2503] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:37.307464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:37.307908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:37.308664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:37.309096 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:37.322418 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] HTTP exception thrown: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 could not be found. May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Request method failure captured: May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 HTTP/1.1 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JLQwW9F_iSrYfsCSJcOyPs6IDUbEVekJsZBZzSip5wVBdO0j7saQv47K7fwvjQSCAfcSJEBbJlBoWtJ1z7eRDag5jZnAgLohF_IEC6l9EDycghetO2wwQyuvcubo5CbCdJ3XvER5o6CMPuZvZ9FIclMk_5_eFR2-IzClgfM_RUI_8 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:49:37.324004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/87cc0cd3d0df4dccbc28058b6866d076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/87cc0cd3d0df4dccbc28058b6866d076"}]}] May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 87cc0cd3d0df4dccbc28058b6866d076 May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-331336201 May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: b40c7b11fff443fa8c78e8647703e230 May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-ServerRescueNegativeTestJSON-331336201-project May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 could not be found. May 17 15:49:37.325599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '1e592f5a-3f22-48bd-b517-5ddd4d5c2503'} May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 could not be found. May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:37.326561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 could not be found. May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 could not be found. May 17 15:49:37.328090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:37.329537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] Returning 404 to user: Instance 1e592f5a-3f22-48bd-b517-5ddd4d5c2503 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:37.329537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9f309fb6-bd29-4280-ae3b-3a69f45968ae tempest-ServerRescueNegativeTestJSON-331336201 tempest-ServerRescueNegativeTestJSON-331336201-project] 10.222.0.75 "GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503" status: 404 len: 111 microversion: 2.1 time: 0.028673 May 17 15:49:37.329537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 371/743] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:37 2022] GET /compute/v2.1/servers/1e592f5a-3f22-48bd-b517-5ddd4d5c2503 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:49:37.376479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:37.377577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:49:37.384836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:37.385307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:37.386116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:37.387016 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:37.522623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:49:37.530084 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6ec8a1e9-e1a5-49e8-9585-19b3359b6284 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1562 microversion: 2.1 time: 0.157390 May 17 15:49:37.530656 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 373/744] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:49:37 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:49:38.651023 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-dd9b4524-fca7-45d9-987a-2bd6c00d5bfc req-fd123c92-f52c-435e-9e36-3f1c066b0ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "name": "network-vif-plugged", "status": "completed", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:38.665500 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-dd9b4524-fca7-45d9-987a-2bd6c00d5bfc req-fd123c92-f52c-435e-9e36-3f1c066b0ca9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:49:38.665979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-dd9b4524-fca7-45d9-987a-2bd6c00d5bfc req-fd123c92-f52c-435e-9e36-3f1c066b0ca9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:49:38.679303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-dd9b4524-fca7-45d9-987a-2bd6c00d5bfc req-fd123c92-f52c-435e-9e36-3f1c066b0ca9 service nova] Creating event network-vif-plugged:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:49:38.684893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-dd9b4524-fca7-45d9-987a-2bd6c00d5bfc req-fd123c92-f52c-435e-9e36-3f1c066b0ca9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037913 May 17 15:49:38.685775 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 372/745] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:41.697550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b30caa82-adbc-48ce-83d0-68a4daa3526f tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Action: 'create', calling method: .version_select at 0x7f84005aadc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-720817539"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:41.975786 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b30caa82-adbc-48ce-83d0-68a4daa3526f tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.387899 May 17 15:49:41.976701 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 374/746] 10.222.0.75 () {60 vars in 1154 bytes} [Tue May 17 15:49:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 15:49:41.988842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f3e90f07-7321-4453-9078-7d97e2b6742c tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f750b160>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:42.042197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f3e90f07-7321-4453-9078-7d97e2b6742c tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 200 len: 344 microversion: 2.1 time: 0.058068 May 17 15:49:42.042772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 373/747] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:49:41 2022] GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:49:43.055009 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-53d9817a-13aa-4a81-8827-4ad184bf597d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f840056bd30>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:43.100083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-53d9817a-13aa-4a81-8827-4ad184bf597d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 200 len: 345 microversion: 2.1 time: 0.049344 May 17 15:49:43.100641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 375/748] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:49:43 2022] GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:43.112646 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c8233be1-6bfd-42e1-8f67-26657cc1b274 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Action: 'create', calling method: .version_select at 0x7f83f7392ca0>, body: {"snapshot": {"volume_id": "4b055629-1bbb-478d-9fa6-c4200d036d0a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-773392412"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:49:43.250398 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c8233be1-6bfd-42e1-8f67-26657cc1b274 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.142398 May 17 15:49:43.251076 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 374/749] 10.222.0.75 () {60 vars in 1161 bytes} [Tue May 17 15:49:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:43.261387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5f8ffc48-f226-4697-87a5-43ced3fc3ad2 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f84005e2160>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:43.290782 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5f8ffc48-f226-4697-87a5-43ced3fc3ad2 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.033316 May 17 15:49:43.291553 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 376/750] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:43 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:43.301151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b6f1733f-c435-4538-b233-e9097565149e tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f7636ee0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:43.329734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b6f1733f-c435-4538-b233-e9097565149e tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032420 May 17 15:49:43.330902 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 375/751] 10.222.0.75 () {58 vars in 1139 bytes} [Tue May 17 15:49:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:43.340656 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b2283177-dd9c-409b-a0f2-7ede84708d31 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f840050c430>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:43.368035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b2283177-dd9c-409b-a0f2-7ede84708d31 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.031060 May 17 15:49:43.368621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 377/752] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:43 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:44.379924 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-14b5fa92-f29f-45ea-b691-de6bf7cc4c32 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f73c7b80>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:44.407773 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-14b5fa92-f29f-45ea-b691-de6bf7cc4c32 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.032127 May 17 15:49:44.408955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 376/753] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:44 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:45.420154 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4b999ac7-b3b0-4d41-89f1-a252652f1867 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f840050c280>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:45.450188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4b999ac7-b3b0-4d41-89f1-a252652f1867 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.034388 May 17 15:49:45.450743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 378/754] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:45 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:46.462624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bcafc576-ea8b-4a49-8ccb-975193a13465 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f73bd8b0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:46.491268 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bcafc576-ea8b-4a49-8ccb-975193a13465 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.032960 May 17 15:49:46.491818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 377/755] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:46 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:47.503465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8eb7435e-6f38-4ecd-96ce-0235d12b4fac tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f840050cb80>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:47.531428 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8eb7435e-6f38-4ecd-96ce-0235d12b4fac tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.032951 May 17 15:49:47.531979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 379/756] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:47 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:48.544584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9139fd5b-dbd9-487f-a069-aa313599dbcb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f74d03a0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:48.573161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9139fd5b-dbd9-487f-a069-aa313599dbcb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 287 microversion: 2.1 time: 0.032850 May 17 15:49:48.574055 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 378/757] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:48 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:48.585045 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b5b5f068-c844-4f58-96ec-ff18277a0900 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f8400637820>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:48.639134 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b5b5f068-c844-4f58-96ec-ff18277a0900 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 202 len: 0 microversion: 2.1 time: 0.058903 May 17 15:49:48.639800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 380/758] 10.222.0.75 () {58 vars in 1253 bytes} [Tue May 17 15:49:48 2022] DELETE /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:49:48.648691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-06ad11a0-8e8c-4678-b3fc-5435a8072169 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f73a8a60>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:48.676766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-06ad11a0-8e8c-4678-b3fc-5435a8072169 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 200 len: 286 microversion: 2.1 time: 0.031809 May 17 15:49:48.677318 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 379/759] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:48 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:49:49.688916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e93f7900-22a4-49d4-af77-a6350f808f0b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f84005da430>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:49.713051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-e93f7900-22a4-49d4-af77-a6350f808f0b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] HTTP exception thrown: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e93f7900-22a4-49d4-af77-a6350f808f0b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Request method failure captured: May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 HTTP/1.1 May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8QVaGV71icqtErmXJCiSLmF54fEE-lEBHBrFYsxJT1X5V4DJzBnjBuKQaEJ_oN1o3cGE_DQ947lsroq1hVCOQO7hdcPOXAMnTswQQyAFoDyFTfkj55EkuTWLGMQ3xJrze-E1NXJyIq1_m5DlUyuWi8AomEhYBxHUHvBulxsZiWuXCg May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:49:49.715369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9d60e9e497094744b410f33cbfce2b66"}]}] May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 5897859fb64c426e804259d2449e96f5 May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '2c17d532-73fb-487e-8d74-7e09cb66a148'} May 17 15:49:49.716894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. (HTTP 404) (Request-ID: req-541e3399-5aa9-441d-9156-67c132332171) May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.717969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:49:49.719425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 15:49:49.721007 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e93f7900-22a4-49d4-af77-a6350f808f0b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Returning 404 to user: Snapshot 2c17d532-73fb-487e-8d74-7e09cb66a148 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:49.722402 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e93f7900-22a4-49d4-af77-a6350f808f0b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148" status: 404 len: 111 microversion: 2.1 time: 0.032104 May 17 15:49:49.723345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 381/760] 10.222.0.75 () {58 vars in 1250 bytes} [Tue May 17 15:49:49 2022] GET /compute/v2.1/os-snapshots/2c17d532-73fb-487e-8d74-7e09cb66a148 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:49:49.724967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c6b89bc4-0ba8-4df8-872b-9a3c4e1ce25b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f74d60d0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:49.785776 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c6b89bc4-0ba8-4df8-872b-9a3c4e1ce25b tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 202 len: 0 microversion: 2.1 time: 0.064336 May 17 15:49:49.786394 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 380/761] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:49:49 2022] DELETE /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:49:49.794572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-91960492-feb0-45c8-9256-388be8495e72 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f8400637a60>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:49.840664 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-91960492-feb0-45c8-9256-388be8495e72 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 200 len: 344 microversion: 2.1 time: 0.049722 May 17 15:49:49.841228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 382/762] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:49:49 2022] GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:49:50.854556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-515c0300-866a-44f8-b5f3-29a6855e6a4d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f74d01f0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:50.881305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-515c0300-866a-44f8-b5f3-29a6855e6a4d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] HTTP exception thrown: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-515c0300-866a-44f8-b5f3-29a6855e6a4d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Request method failure captured: May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a HTTP/1.1 May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8QVaGV71icqtErmXJCiSLmF54fEE-lEBHBrFYsxJT1X5V4DJzBnjBuKQaEJ_oN1o3cGE_DQ947lsroq1hVCOQO7hdcPOXAMnTswQQyAFoDyFTfkj55EkuTWLGMQ3xJrze-E1NXJyIq1_m5DlUyuWi8AomEhYBxHUHvBulxsZiWuXCg May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:49:50.884641 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9d60e9e497094744b410f33cbfce2b66"}]}] May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 5897859fb64c426e804259d2449e96f5 May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '4b055629-1bbb-478d-9fa6-c4200d036d0a'} May 17 15:49:50.886209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. (HTTP 404) (Request-ID: req-1e2d4e14-1c7a-4c7a-aa5f-b37ae51ecf13) May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.887137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:49:50.888546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 15:49:50.890693 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-515c0300-866a-44f8-b5f3-29a6855e6a4d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Returning 404 to user: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-515c0300-866a-44f8-b5f3-29a6855e6a4d tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 404 len: 109 microversion: 2.1 time: 0.036573 May 17 15:49:50.893628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 381/763] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:49:50 2022] GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 15:49:50.900858 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c670c94b-36d2-4a97-8d18-0b467c32fd30 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f840056b4c0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:50.926436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-c670c94b-36d2-4a97-8d18-0b467c32fd30 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] HTTP exception thrown: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c670c94b-36d2-4a97-8d18-0b467c32fd30 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Request method failure captured: May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: DELETE /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a HTTP/1.1 May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8QVaGV71icqtErmXJCiSLmF54fEE-lEBHBrFYsxJT1X5V4DJzBnjBuKQaEJ_oN1o3cGE_DQ947lsroq1hVCOQO7hdcPOXAMnTswQQyAFoDyFTfkj55EkuTWLGMQ3xJrze-E1NXJyIq1_m5DlUyuWi8AomEhYBxHUHvBulxsZiWuXCg May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:49:50.928397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9d60e9e497094744b410f33cbfce2b66"}]}] May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 5897859fb64c426e804259d2449e96f5 May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '4b055629-1bbb-478d-9fa6-c4200d036d0a'} May 17 15:49:50.929943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. (HTTP 404) (Request-ID: req-ee58cd22-d0de-4fc5-b062-f9e3004e1cac) May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.930960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 15:49:50.932228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 15:49:50.933372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c670c94b-36d2-4a97-8d18-0b467c32fd30 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Returning 404 to user: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c670c94b-36d2-4a97-8d18-0b467c32fd30 tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 404 len: 109 microversion: 2.1 time: 0.033173 May 17 15:49:50.934504 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 383/764] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:49:50 2022] DELETE /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:49:50.938809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4e89b8a1-b3a1-4d26-a4a1-dccf19dc2efb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Calling method '.version_select at 0x7f83f734ddc0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:49:50.965445 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-4e89b8a1-b3a1-4d26-a4a1-dccf19dc2efb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] HTTP exception thrown: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4e89b8a1-b3a1-4d26-a4a1-dccf19dc2efb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Request method failure captured: May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a HTTP/1.1 May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8QVaGV71icqtErmXJCiSLmF54fEE-lEBHBrFYsxJT1X5V4DJzBnjBuKQaEJ_oN1o3cGE_DQ947lsroq1hVCOQO7hdcPOXAMnTswQQyAFoDyFTfkj55EkuTWLGMQ3xJrze-E1NXJyIq1_m5DlUyuWi8AomEhYBxHUHvBulxsZiWuXCg May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:49:50.967455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/9d60e9e497094744b410f33cbfce2b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/9d60e9e497094744b410f33cbfce2b66"}]}] May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 9d60e9e497094744b410f33cbfce2b66 May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1838858407 May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 5897859fb64c426e804259d2449e96f5 May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1838858407-project May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '4b055629-1bbb-478d-9fa6-c4200d036d0a'} May 17 15:49:50.968936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. (HTTP 404) (Request-ID: req-338586b2-6055-4d6b-91d2-b3bb75e50e04) May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.969922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 15:49:50.971901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 15:49:50.973293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4e89b8a1-b3a1-4d26-a4a1-dccf19dc2efb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] Returning 404 to user: Volume 4b055629-1bbb-478d-9fa6-c4200d036d0a could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4e89b8a1-b3a1-4d26-a4a1-dccf19dc2efb tempest-VolumesSnapshotsTestJSON-1838858407 tempest-VolumesSnapshotsTestJSON-1838858407-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a" status: 404 len: 109 microversion: 2.1 time: 0.034520 May 17 15:49:50.974661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 382/765] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 15:49:50 2022] GET /compute/v2.1/os-volumes/4b055629-1bbb-478d-9fa6-c4200d036d0a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:50:38.005792 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:38.006409 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:38.012425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:38.012878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:38.013654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:38.014133 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:38.037085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f7317695-647f-4418-8012-0c54197360a8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/ips" status: 200 len: 150 microversion: 2.1 time: 0.036441 May 17 15:50:38.037643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 384/766] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:50:37 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:50:39.340639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d64d90f-ead9-4b93-a8ed-47eada1cd17c"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:39.341817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:39.349309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:39.349759 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:39.350554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:39.350996 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:39.579562 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f65561fc-98c5-4acd-b311-c0f2eb4df453 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.243336 May 17 15:50:39.580247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 383/767] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:50:39 2022] POST /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments => generated 194 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:50:47.052202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d64d90f-ead9-4b93-a8ed-47eada1cd17c"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:47.053308 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:47.059633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:47.060086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:47.060860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:47.061303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:47.144621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Invalid volume: volume 9d64d90f-ead9-4b93-a8ed-47eada1cd17c is already attached to instances: 07336f08-accf-4aea-8682-5efa8f66d850 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: POST /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments HTTP/1.1 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 74 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:50:47.146273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {"volumeAttachment": {"volumeId": "9d64d90f-ead9-4b93-a8ed-47eada1cd17c"}} May 17 15:50:47.147854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Invalid volume: volume 9d64d90f-ead9-4b93-a8ed-47eada1cd17c is already attached to instances: 07336f08-accf-4aea-8682-5efa8f66d850 May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'server_id': '07336f08-accf-4aea-8682-5efa8f66d850', 'body': {'volumeAttachment': {'volumeId': '9d64d90f-ead9-4b93-a8ed-47eada1cd17c'}}} May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9d64d90f-ead9-4b93-a8ed-47eada1cd17c is already attached to instances: 07336f08-accf-4aea-8682-5efa8f66d850 May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:47.149305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9d64d90f-ead9-4b93-a8ed-47eada1cd17c is already attached to instances: 07336f08-accf-4aea-8682-5efa8f66d850 May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:50:47.150796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9d64d90f-ead9-4b93-a8ed-47eada1cd17c is already attached to instances: 07336f08-accf-4aea-8682-5efa8f66d850 May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 400 to user: Invalid volume: volume 9d64d90f-ead9-4b93-a8ed-47eada1cd17c is already attached to instances: 07336f08-accf-4aea-8682-5efa8f66d850 {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-361eb4dc-2424-49c0-9b14-466656543037 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099502 May 17 15:50:47.152251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 385/768] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:50:47 2022] POST /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 15:50:47.208536 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:47.209124 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:47.215289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:47.215744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:47.216519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:47.216957 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:47.294563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lazy-loading 'services' on Instance uuid 07336f08-accf-4aea-8682-5efa8f66d850 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:50:47.363211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-578f85e7-5131-457e-852a-bad0d2754fa5 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments/9d64d90f-ead9-4b93-a8ed-47eada1cd17c" status: 202 len: 0 microversion: 2.1 time: 0.159886 May 17 15:50:47.363800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 384/769] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:50:47 2022] DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments/9d64d90f-ead9-4b93-a8ed-47eada1cd17c => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:50:47.372015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:47.373037 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:47.380727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:47.381310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:47.382368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:47.382817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:47.412378 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a5400465-6de9-4023-b94d-bcb802e1765b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 May 17 15:50:47.413020 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 386/770] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:50:47 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:50:48.424222 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:48.425281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:48.431766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:48.432206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:48.432966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:48.433397 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:48.461903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-dcc28a2c-8dd2-4ced-97fc-bd575e0f3b04 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042101 May 17 15:50:48.462476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 385/771] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:50:48 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:50:48.517162 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:48.517668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:48.527083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:48.527547 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:48.528335 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:48.528780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:48.554178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:50:48.631074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-beba5548-75e8-4949-809c-7a5b8edf9773 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 204 len: 0 microversion: 2.1 time: 0.117239 May 17 15:50:48.631835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 387/772] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:50:48 2022] DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:50:48.640382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:48.641006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:48.647448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:48.647886 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:48.648636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:48.649064 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:48.776368 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:48.783782 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7df840ba-eac4-4e76-8913-4ad33bee645d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1682 microversion: 2.1 time: 0.147187 May 17 15:50:48.784345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 386/773] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:48 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:49.801317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:49.802056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:49.808369 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:49.808823 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:49.809601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:49.810137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:49.938974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:49.946843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-94d9c9a7-bc2a-4c40-8cf9-6a1c52749e07 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1682 microversion: 2.1 time: 0.149766 May 17 15:50:49.947411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 388/774] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:49 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:50.963209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:50.963756 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:50.970214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:50.970661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:50.971430 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:50.971862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:51.151517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:51.158973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b1631bd5-fc39-436a-9409-afe9b8007045 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1682 microversion: 2.1 time: 0.199594 May 17 15:50:51.160399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 387/775] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:50 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:51.475377 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-5fd6fbab-4ad5-426d-81e1-c69c7fd84302 req-9c31f04b-e03d-43c3-9956-dc18bf958b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07336f08-accf-4aea-8682-5efa8f66d850", "name": "network-vif-deleted", "tag": "b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:51.487116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-5fd6fbab-4ad5-426d-81e1-c69c7fd84302 req-9c31f04b-e03d-43c3-9956-dc18bf958b10 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:51.487563 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-5fd6fbab-4ad5-426d-81e1-c69c7fd84302 req-9c31f04b-e03d-43c3-9956-dc18bf958b10 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:51.502728 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-5fd6fbab-4ad5-426d-81e1-c69c7fd84302 req-9c31f04b-e03d-43c3-9956-dc18bf958b10 service nova] Creating event network-vif-deleted:b109c6fb-d9d9-4da5-9dd8-4e94cdfb2b8f for instance 07336f08-accf-4aea-8682-5efa8f66d850 on hv-cinder-84212 May 17 15:50:51.508840 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-5fd6fbab-4ad5-426d-81e1-c69c7fd84302 req-9c31f04b-e03d-43c3-9956-dc18bf958b10 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037452 May 17 15:50:51.509635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 389/776] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:50:52.179321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:52.179987 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:52.187241 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:52.187763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:52.188503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:52.188970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:52.226561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:52.227533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:52.228158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lazy-loading 'fault' on Instance uuid 07336f08-accf-4aea-8682-5efa8f66d850 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:50:52.274825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:52.281593 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-465675a1-0a71-4c97-90d7-466611567372 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 200 len: 1331 microversion: 2.1 time: 0.107633 May 17 15:50:52.282185 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 388/777] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:52 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:53.299580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:53.300843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:53.307343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:53.307821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:53.308588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:53.309022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:53.322683 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 HTTP/1.1 May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:50:53.324302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:50:53.325843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '07336f08-accf-4aea-8682-5efa8f66d850'} May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:50:53.327397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:50:53.328585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:50:53.329940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:50:53.329940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6edc79b8-921f-46ec-9d45-5845b5c9aa29 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 404 len: 111 microversion: 2.1 time: 0.030283 May 17 15:50:53.329940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 390/778] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:53 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:50:53.334479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2ed50cef-885a-4bfa-9a3b-df696edae74f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '.version_select at 0x7f83f73c7160>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:53.351324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2ed50cef-885a-4bfa-9a3b-df696edae74f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675718945" status: 202 len: 0 microversion: 2.1 time: 0.020649 May 17 15:50:53.351876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 389/779] 10.222.0.75 () {58 vars in 1220 bytes} [Tue May 17 15:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675718945 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:50:53.947697 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-76f6431c-9532-48ea-a469-354d51696a6d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: .version_select at 0x7f840056b940>, body: {"keypair": {"name": "tempest-keypair-1939334892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWF1rfwvB+jv+c7RhhZT4OF4cGGbdvLicyzXhriTbDaxdWySIeYZhJa+fiBaaXkjx4T62jGdFQQtrqberL+FbDd4yOVfLYM+iGmBRowWznIKIx5aEgav3v02pqeGSNlHA=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:53.961598 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-76f6431c-9532-48ea-a469-354d51696a6d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:50:53.965361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-76f6431c-9532-48ea-a469-354d51696a6d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:50:53.987135 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-76f6431c-9532-48ea-a469-354d51696a6d tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043301 May 17 15:50:53.988234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 391/780] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:50:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:50:54.313535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:54.313535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:54.319240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:54.319847 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:54.320769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:54.321270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:54.345893 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2a067197-0667-4cd6-84b3-f7878afae3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/ips" status: 200 len: 152 microversion: 2.20 time: 0.039063 May 17 15:50:54.346546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 390/781] 10.222.0.75 () {60 vars in 1288 bytes} [Tue May 17 15:50:54 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:50:55.469803 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-317762217", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "670d118c-c4c6-4faf-9e34-d28bf36911ac"}], "security_groups": [{"name": "tempest-securitygroup--1144023976"}], "key_name": "tempest-keypair-1939334892", "user_data": "}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:55.568584 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] validate_networks() for [('670d118c-c4c6-4faf-9e34-d28bf36911ac', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:50:56.011254 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:50:56.011681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:50:56.012174 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:50:56.012597 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:50:56.013010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:50:56.022090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:56.022539 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:56.023332 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:56.023764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:56.039311 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:50:56.043081 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Getting quotas for user d099a8ecc77b4259aa30f227ae8f28ad and project b23dc4cf2a954ab8a64c81eac9080a70. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:50:56.053483 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:50:56.055719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:50:56.099767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e61be397-8598-4b51-bc3f-1399fc106747 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.634161 May 17 15:50:56.100454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 392/782] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:50:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:50:56.110535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d2a561bd-326f-44b1-ae14-360a4b37709b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:56.111230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d2a561bd-326f-44b1-ae14-360a4b37709b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:56.157820 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:56.158606 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:56.165511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:56.166594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:56.167413 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:56.167856 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:56.169090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d2a561bd-326f-44b1-ae14-360a4b37709b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:56.176541 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d2a561bd-326f-44b1-ae14-360a4b37709b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1241 microversion: 2.1 time: 0.069615 May 17 15:50:56.186030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 391/783] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:56 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:56.192017 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lazy-loading 'flavor' on Instance uuid 0748c249-ac72-4f86-956e-d02cac507f75 {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:50:56.457337 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bce5cf85-91ab-4229-93a0-1e6559bc6e65 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/action" status: 202 len: 0 microversion: 2.20 time: 0.302514 May 17 15:50:56.457947 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 393/784] 10.222.0.75 () {62 vars in 1318 bytes} [Tue May 17 15:50:56 2022] POST /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 15:50:56.465963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:56.466601 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:56.473664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:56.474209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:56.475257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:56.475864 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:56.609441 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:56.617985 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:56.619494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:56.620643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-07ebf22d-88ea-48fe-b132-3368bcb82966 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.158654 May 17 15:50:56.626636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 392/785] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:50:56 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:50:57.195210 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:57.195922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:57.202793 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:57.203246 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:57.204027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:57.204470 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:57.279489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:57.286801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d6e8c3dc-1710-4ad0-a0a1-da1536d83108 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1299 microversion: 2.1 time: 0.096970 May 17 15:50:57.296180 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 394/786] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:57 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:57.643281 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:57.643898 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:57.650159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:57.650615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:57.651384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:57.651830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:57.864813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:57.872986 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:57.874667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:57.875853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-af79eeac-2c7c-4ac6-8514-e4c8334e0446 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.236421 May 17 15:50:57.876773 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 393/787] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:50:57 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:50:58.303736 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:58.304354 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:58.311671 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:58.312151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:58.312923 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:58.313362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:58.496405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:58.505138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-95806c8f-fd98-44cd-8b94-eddcc4b90593 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.205170 May 17 15:50:58.505987 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 395/788] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:58 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:50:58.577860 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-4b29466f-0ae0-474a-a180-0d1f15481bce req-3d157765-c6f1-4b8b-bc0c-24ec343aa686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542eabc5-0397-4192-be08-167bb6e4ab75", "tag": "f52b50f9-a507-4651-8cf9-47e24b497db7"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:50:58.590257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-4b29466f-0ae0-474a-a180-0d1f15481bce req-3d157765-c6f1-4b8b-bc0c-24ec343aa686 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:58.591227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-4b29466f-0ae0-474a-a180-0d1f15481bce req-3d157765-c6f1-4b8b-bc0c-24ec343aa686 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:58.615140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-4b29466f-0ae0-474a-a180-0d1f15481bce req-3d157765-c6f1-4b8b-bc0c-24ec343aa686 service nova] Creating event network-changed:f52b50f9-a507-4651-8cf9-47e24b497db7 for instance 542eabc5-0397-4192-be08-167bb6e4ab75 on hv-cinder-84212 May 17 15:50:58.620875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-4b29466f-0ae0-474a-a180-0d1f15481bce req-3d157765-c6f1-4b8b-bc0c-24ec343aa686 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049567 May 17 15:50:58.621475 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 394/789] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:50:58.894783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:58.895511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:58.901953 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:58.902438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:58.903298 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:58.903812 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:59.180966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:59.188721 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:59.190265 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:59.191443 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bf3891bf-c778-4da2-8f16-7bfb2219899c tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.300652 May 17 15:50:59.191998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 396/790] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:50:58 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:50:59.523201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:50:59.523825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:50:59.530411 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:59.531129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:59.531910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:50:59.532502 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:50:59.661685 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:50:59.671984 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0b095fa5-dfeb-44b2-89e4-6487da302753 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.153671 May 17 15:50:59.672560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 395/791] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:50:59 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:00.210519 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:00.211129 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:00.217659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:00.218177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:00.219035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:00.219424 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:00.346772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:00.355389 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:00.356899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:00.358098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-06284d5e-e1df-4c6a-947e-688d6efe68b8 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.152010 May 17 15:51:00.358658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 397/792] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:00 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:00.688287 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:00.688945 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:00.697524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:00.698360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:00.699297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:00.699746 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:00.827869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:00.835120 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-86df4972-dad2-4536-8f13-0385b33aaec6 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.150681 May 17 15:51:00.835684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 396/793] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:00 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:01.377208 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:01.377817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:01.384140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:01.384582 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:01.385609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:01.386076 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:01.582539 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:01.590454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:01.591963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:01.593118 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2f1cc06d-1e37-4cae-b55a-dab255f5cb62 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.219862 May 17 15:51:01.593681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 398/794] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:01 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:01.852640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:01.853372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:01.859668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:01.860121 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:01.860900 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:01.861338 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:02.009748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:02.017002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-84d0ace2-198d-4e2a-9d84-91de098b575c tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.168449 May 17 15:51:02.017570 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 397/795] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:01 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:02.611999 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:02.612620 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:02.619046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:02.619524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:02.620301 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:02.620744 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:02.745806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:02.755927 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:02.757445 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:02.758650 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-43d2d7f8-f611-4adb-a0c5-5b9ecd44afa4 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.150859 May 17 15:51:02.759250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 399/796] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:02 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:03.034407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:03.035083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:03.041315 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:03.041768 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:03.042571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:03.043015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:03.178880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:03.192865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8dcdba21-9f46-42bb-8a7b-c751032a80f2 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.162323 May 17 15:51:03.193384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 398/797] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:03 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:03.776991 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:03.777513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:03.783821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:03.784265 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:03.785022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:03.785456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:03.914841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:03.922466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:03.923965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:03.925597 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ad7797b2-f34d-45b6-b6e0-86c54d836135 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.152084 May 17 15:51:03.926203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 400/798] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:03 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:04.209621 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:04.210293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:04.216687 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:04.217135 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:04.217894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:04.218354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:04.343574 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:04.350826 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-963e4a90-41d0-4b9a-a789-22b57bea5247 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.145743 May 17 15:51:04.351450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 399/799] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:04 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:04.944596 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:04.945214 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:04.951617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:04.952089 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:04.952861 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:04.953299 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:05.089687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:05.093472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-e7521564-fa8f-40e3-b506-aee207ddeba8 req-5cf1895f-4eb0-4c7d-a62e-97bb15c03464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542eabc5-0397-4192-be08-167bb6e4ab75", "name": "network-vif-plugged", "status": "completed", "tag": "f52b50f9-a507-4651-8cf9-47e24b497db7"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:05.100560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:05.102498 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e7521564-fa8f-40e3-b506-aee207ddeba8 req-5cf1895f-4eb0-4c7d-a62e-97bb15c03464 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:05.102676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:05.103172 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e7521564-fa8f-40e3-b506-aee207ddeba8 req-5cf1895f-4eb0-4c7d-a62e-97bb15c03464 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:05.103940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5cd935ea-8e0d-4e22-a71e-f1783b3e9161 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.164004 May 17 15:51:05.104639 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 401/800] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:04 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:05.114863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-e7521564-fa8f-40e3-b506-aee207ddeba8 req-5cf1895f-4eb0-4c7d-a62e-97bb15c03464 service nova] Creating event network-vif-plugged:f52b50f9-a507-4651-8cf9-47e24b497db7 for instance 542eabc5-0397-4192-be08-167bb6e4ab75 on hv-cinder-84212 May 17 15:51:05.119706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-e7521564-fa8f-40e3-b506-aee207ddeba8 req-5cf1895f-4eb0-4c7d-a62e-97bb15c03464 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 May 17 15:51:05.120295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 400/801] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:51:05.368268 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:05.368885 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:05.374822 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:05.375282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:05.376051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:05.376493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:05.502307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:05.510158 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-61295565-8995-4627-be69-0725d842fc9a tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.145772 May 17 15:51:05.510723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 402/802] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:05 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:06.123167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:06.123859 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:06.129899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:06.130429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:06.131191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:06.131625 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:06.261845 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:06.270202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:06.271723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:06.272876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2e2df10b-b289-4d86-aa24-27900d02da4f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.154401 May 17 15:51:06.273448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 401/803] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:06 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:06.526510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:06.527125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:06.533573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:06.534061 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:06.535345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:06.535785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:06.662303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:06.669557 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b545c246-7b99-485f-ad80-fad58437806f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1367 microversion: 2.1 time: 0.146886 May 17 15:51:06.670156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 403/804] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:06 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:07.290947 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:07.291594 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:07.297891 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:07.298385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:07.299156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:07.299596 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:07.427922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:07.435628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:07.437163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:07.438342 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2fad4eaf-1a1a-4159-82ca-e2ddc083a244 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.151379 May 17 15:51:07.438901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 402/805] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:07 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:07.687164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:07.687711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:07.694761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:07.695221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:07.696001 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:07.696444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:07.819924 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:07.827327 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-23f74866-874a-43f2-bf8c-f100418dbb09 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1558 microversion: 2.1 time: 0.144048 May 17 15:51:07.827905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 404/806] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:07 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1558 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:07.843140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:07.843629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:07.849890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:07.850371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:07.851130 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:07.851559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:07.932117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d353e7e0-fd19-41f9-9416-1a6070cbc9e8 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092721 May 17 15:51:07.932748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 403/807] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:51:07 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:51:08.457364 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:08.457979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:08.463916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:08.464354 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:08.465124 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:08.465586 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:08.681922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:08.689638 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:08.691666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:08.692806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-76c91a2a-e5b0-45e9-b014-87d4c4a97f61 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1744 microversion: 2.20 time: 0.240092 May 17 15:51:08.693366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 405/808] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:08 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1744 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:08.891490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-ac1315c1-1c03-4e0c-b656-1d10d1be06fe req-a95a30b5-fa02-431f-91cb-e442175e8d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542eabc5-0397-4192-be08-167bb6e4ab75", "tag": "f52b50f9-a507-4651-8cf9-47e24b497db7"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:08.900070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ac1315c1-1c03-4e0c-b656-1d10d1be06fe req-a95a30b5-fa02-431f-91cb-e442175e8d18 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:08.900519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ac1315c1-1c03-4e0c-b656-1d10d1be06fe req-a95a30b5-fa02-431f-91cb-e442175e8d18 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:08.911378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-ac1315c1-1c03-4e0c-b656-1d10d1be06fe req-a95a30b5-fa02-431f-91cb-e442175e8d18 service nova] Creating event network-changed:f52b50f9-a507-4651-8cf9-47e24b497db7 for instance 542eabc5-0397-4192-be08-167bb6e4ab75 on hv-cinder-84212 May 17 15:51:08.916654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-ac1315c1-1c03-4e0c-b656-1d10d1be06fe req-a95a30b5-fa02-431f-91cb-e442175e8d18 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029181 May 17 15:51:08.917462 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 404/809] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:51:09.712034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:09.712761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:09.718998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:09.719557 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:09.720405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:09.720913 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:09.853513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:09.861436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:09.863466 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:09.864634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b5ac43d0-93b6-4480-afcd-14bf0c645c39 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1744 microversion: 2.20 time: 0.156743 May 17 15:51:09.865205 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 406/810] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:09 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:10.883672 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:10.884372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:10.890953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:10.891409 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:10.892179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:10.892619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:11.018701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:11.026364 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:11.027857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:11.029006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-52d0423b-e28d-417a-8377-d2f3bb8aa42a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1744 microversion: 2.20 time: 0.149637 May 17 15:51:11.029568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 405/811] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:10 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:51:12.047758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:12.048290 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:12.054613 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:12.055058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:12.055818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:12.056248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:12.183411 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:12.191208 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:12.192723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:12.193889 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-27e6fd34-a37b-47ff-a65e-43dfb5c52f48 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1744 microversion: 2.20 time: 0.150071 May 17 15:51:12.194489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 407/812] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:12 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:13.143211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-e1b92e3e-191c-440b-a6d3-09a1bbbd3d30 req-c38adbbc-0983-4169-ac34-52bc29ebeb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "name": "network-vif-plugged", "status": "completed", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:13.152510 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e1b92e3e-191c-440b-a6d3-09a1bbbd3d30 req-c38adbbc-0983-4169-ac34-52bc29ebeb32 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:13.152964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-e1b92e3e-191c-440b-a6d3-09a1bbbd3d30 req-c38adbbc-0983-4169-ac34-52bc29ebeb32 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:13.164465 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-e1b92e3e-191c-440b-a6d3-09a1bbbd3d30 req-c38adbbc-0983-4169-ac34-52bc29ebeb32 service nova] Creating event network-vif-plugged:3147fce3-6722-4f48-9760-c37ce1f654e6 for instance 0748c249-ac72-4f86-956e-d02cac507f75 on hv-cinder-84212 May 17 15:51:13.169392 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-e1b92e3e-191c-440b-a6d3-09a1bbbd3d30 req-c38adbbc-0983-4169-ac34-52bc29ebeb32 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 May 17 15:51:13.170043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 406/813] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:51:13.218989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:13.219605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:13.226433 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:13.226887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:13.227954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:13.228395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:13.353313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:13.361002 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:13.363164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:13.364319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8fb9c4da-6ecf-4e24-9b24-9602eabcfcaf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1744 microversion: 2.20 time: 0.149485 May 17 15:51:13.364888 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 408/814] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:13 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:14.382539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:14.383221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:14.389291 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:14.389763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:14.390546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:14.390979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:14.520985 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:14.528697 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:14.530214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:14.531356 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7a3b3be6-80ac-48be-9374-89f1716ca09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1744 microversion: 2.20 time: 0.153483 May 17 15:51:14.531906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 407/815] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:14 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:15.550988 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:15.551600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:15.557966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:15.558454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:15.559225 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:15.559663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:15.693426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:15.701340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:15.702877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:15.704035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-cedd6729-4bd2-460c-92ed-1cb9cf81f09e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.157624 May 17 15:51:15.705091 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 409/816] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:15 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:16.723779 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:16.725143 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:16.732042 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:16.732742 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:16.733580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:16.734072 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:16.872413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:16.906377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:16.909227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:16.910987 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e8c7383e-a919-4536-832f-5b430dd7b897 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.192016 May 17 15:51:16.912151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 408/817] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:16 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:17.930483 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:17.931278 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:17.939241 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:17.939702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:17.940514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:17.940955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:18.091323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:18.102995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:18.104692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:18.105911 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7934beab-07c6-4d29-8275-1449ef37f153 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.179619 May 17 15:51:18.107032 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 410/818] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:17 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:19.124474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:19.126076 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:19.132748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:19.133433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:19.134427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:19.135012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:19.272299 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:19.280889 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:19.282493 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:19.283762 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-db7d00eb-e956-450a-ac34-2dbaf9269dbb tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.163223 May 17 15:51:19.285160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 409/819] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:19 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:20.303773 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:20.304313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:20.311355 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:20.311807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:20.312637 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:20.313240 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:20.459085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:20.467890 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:20.469868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:20.471066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3df5b9a0-254d-4da5-9580-cbece9efec68 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.171859 May 17 15:51:20.471674 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 411/820] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:20 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:51:21.493433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:21.494095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:21.501004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:21.501546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:21.502358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:21.502845 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:21.641792 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:21.649824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:21.651436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:21.652592 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e1eb79f0-5833-4a32-aec1-774ccb44cffe tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.166359 May 17 15:51:21.653150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 410/821] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:21 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:22.676218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:22.676826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:22.683381 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:22.683836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:22.684655 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:22.685113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:22.819395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:22.827936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:22.829431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:22.830648 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-742c58fa-dba0-4109-b267-fa0bb1f36be0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.158972 May 17 15:51:22.841351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 412/822] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:22 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:23.848908 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:23.849720 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:23.856821 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:23.857271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:23.858058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:23.858495 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:24.021341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:24.033452 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:24.035020 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:24.036451 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9be8a62a-93f9-45e7-981d-82a861445567 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.191508 May 17 15:51:24.050548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 411/823] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:23 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:25.057783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:25.058462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:25.065317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:25.065858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:25.072528 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.072813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.073226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.073682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.074073 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.074501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.075158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.075789 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.120777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:51:25.254455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-02310bf9-1f74-4bc7-b270-1990b9e8aaf2 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 204 len: 0 microversion: 2.1 time: 0.193271 May 17 15:51:25.255444 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 412/824] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:51:25 2022] DELETE /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:51:25.263080 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-ac4a808e-475d-40ff-b684-ba7a19cdd059 req-b3ef8f6e-e2e8-4978-ab19-c898e0dd3f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:25.274108 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ac4a808e-475d-40ff-b684-ba7a19cdd059 req-b3ef8f6e-e2e8-4978-ab19-c898e0dd3f46 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.274810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-ac4a808e-475d-40ff-b684-ba7a19cdd059 req-b3ef8f6e-e2e8-4978-ab19-c898e0dd3f46 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.275687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:25.287406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:25.289174 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:25.290663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-03c3eb91-c4b0-42de-911d-916176ab0cd6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.236638 May 17 15:51:25.292263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 413/825] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:25 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:25.296698 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-ac4a808e-475d-40ff-b684-ba7a19cdd059 req-b3ef8f6e-e2e8-4978-ab19-c898e0dd3f46 service nova] Creating event network-changed:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:51:25.297498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:25.298516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:25.304062 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-ac4a808e-475d-40ff-b684-ba7a19cdd059 req-b3ef8f6e-e2e8-4978-ab19-c898e0dd3f46 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046869 May 17 15:51:25.305093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 413/826] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:51:25.308417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.308978 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.311177 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:25.311714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:25.460581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:25.469550 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6ecfe07d-e797-4dcc-a4a6-bfeca12f4dc7 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.176256 May 17 15:51:25.470242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 414/827] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:25 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:26.309583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:26.310347 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:26.317123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:26.317580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:26.318400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:26.318833 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:26.487330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:26.487943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:26.494224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:26.494677 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:26.495446 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:26.495882 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:26.525632 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:26.533481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:26.535664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:26.536913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d6059ff3-a976-4e74-8180-abfc2957f916 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1739 microversion: 2.20 time: 0.232052 May 17 15:51:26.537476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 414/828] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:26 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:26.637615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:26.645496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a52587db-c8f2-46f5-a19e-fe060ad846b3 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.162070 May 17 15:51:26.646082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 415/829] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:26 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:51:27.555357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:27.555937 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:27.562453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:27.562907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:27.563691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:27.564127 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:27.662857 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:27.663506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:27.669398 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:27.669859 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:27.670666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:27.671112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:28.068506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:28.076469 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:28.077875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:28.079168 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ca039cc3-ad5f-49a9-9e6b-46898415e2dd tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1721 microversion: 2.20 time: 0.527861 May 17 15:51:28.079813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 415/830] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:27 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1721 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:28.144801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:28.152992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-acde193a-93ec-4573-a6b6-71e9823599c6 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1568 microversion: 2.1 time: 0.493986 May 17 15:51:28.153556 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 416/831] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:27 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1568 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:51:28.673570 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-9223809d-4893-40af-8209-9acdff12b753 req-ef992b90-037a-4ae1-bc9b-e50c2ad21471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c47a31-9dc4-459c-aa92-3f64baacafd5", "name": "network-vif-deleted", "tag": "feedabaa-7083-406b-9dfe-1149dc1ff973"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:28.684691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-9223809d-4893-40af-8209-9acdff12b753 req-ef992b90-037a-4ae1-bc9b-e50c2ad21471 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:28.685410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-9223809d-4893-40af-8209-9acdff12b753 req-ef992b90-037a-4ae1-bc9b-e50c2ad21471 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:28.698468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-9223809d-4893-40af-8209-9acdff12b753 req-ef992b90-037a-4ae1-bc9b-e50c2ad21471 service nova] Creating event network-vif-deleted:feedabaa-7083-406b-9dfe-1149dc1ff973 for instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 on hv-cinder-84212 May 17 15:51:28.703701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-9223809d-4893-40af-8209-9acdff12b753 req-ef992b90-037a-4ae1-bc9b-e50c2ad21471 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 May 17 15:51:28.704308 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 416/832] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:51:29.099753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:29.100366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:29.107068 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:29.107524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:29.108297 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:29.108755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:29.171446 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:29.172027 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:29.178301 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:29.178744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:29.179519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:29.179957 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:29.248730 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:29.257494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b672b18c-cfec-443d-9235-197e4f9f1e87 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1219 microversion: 2.1 time: 0.090305 May 17 15:51:29.258099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 417/833] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:29 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:51:29.269760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:29.277469 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:29.279051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:29.280193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-12750e09-dc7f-4dc7-b12f-27cdfddd444f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1721 microversion: 2.20 time: 0.184345 May 17 15:51:29.280750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 417/834] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:29 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:30.274700 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:30.275270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:30.281567 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:30.282050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:30.282823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:30.283264 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:30.297726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:30.298385 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:30.304928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:30.305382 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:30.306190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:30.306632 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:30.347248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0e466b56814e10a27304db1bb7b262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8e659223ca4c2a8f4c6836e6a1cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:30.356100 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-546fc3f0-5cf1-45a1-8ffb-4f58dca5a377 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 200 len: 1219 microversion: 2.1 time: 0.085143 May 17 15:51:30.365490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 418/835] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:30 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:51:30.454682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:30.465250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:30.467240 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:30.468652 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b4ff55ab-3d06-4a1c-8c2a-0a5a73099c96 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1721 microversion: 2.20 time: 0.174746 May 17 15:51:30.469706 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 418/836] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:30 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 15:51:31.207357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-2fd3746b-9315-4b11-820e-2f0e4edd3756 req-14b5f931-a1ca-447d-9d4e-93c6de41bd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "name": "network-vif-unplugged", "status": "completed", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:31.216513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-2fd3746b-9315-4b11-820e-2f0e4edd3756 req-14b5f931-a1ca-447d-9d4e-93c6de41bd3f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.217364 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-2fd3746b-9315-4b11-820e-2f0e4edd3756 req-14b5f931-a1ca-447d-9d4e-93c6de41bd3f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.230647 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.compute.server_external_events [req-2fd3746b-9315-4b11-820e-2f0e4edd3756 req-14b5f931-a1ca-447d-9d4e-93c6de41bd3f service nova] Unable to find a host for instance 0748c249-ac72-4f86-956e-d02cac507f75. Dropping event network-vif-unplugged {{(pid=123908) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 15:51:31.231533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-2fd3746b-9315-4b11-820e-2f0e4edd3756 req-14b5f931-a1ca-447d-9d4e-93c6de41bd3f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028488 May 17 15:51:31.232379 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 419/837] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 15:51:31.372602 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:31.373221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] [instance: c0c47a31-9dc4-459c-aa92-3f64baacafd5] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:31.379654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.380108 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.380880 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.381322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.394455 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] HTTP exception thrown: Instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 could not be found. May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Request method failure captured: May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 HTTP/1.1 May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8MUvyFjv2VsiOSMs0aW-4sdrzCnm7oKbeDwYXDe2Img9ivDnWDPMP13efHFmcIP-8HgioiO1IMoixcR_EU5Ml7PuZCCdOBnb1LUAGS2YzHD4_RCFZM7cfdxHiHzrOo1ZlClfBnrHbRCgJJMbyWpX0H_HR7CgSSb8myLRLYkDTuf_Ts May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 4f8e659223ca4c2a8f4c6836e6a1cc18 May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-TestShelveInstance-1530482492 May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:51:31.396126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/4f8e659223ca4c2a8f4c6836e6a1cc18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_4f8e659223ca4c2a8f4c6836e6a1cc18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/4f8e659223ca4c2a8f4c6836e6a1cc18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/4f8e659223ca4c2a8f4c6836e6a1cc18"}]}] May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-TestShelveInstance-1530482492 May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 4f8e659223ca4c2a8f4c6836e6a1cc18 May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-TestShelveInstance-1530482492 May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-TestShelveInstance-1530482492-project May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 7b0e466b56814e10a27304db1bb7b262 May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-TestShelveInstance-1530482492-project May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 could not be found. May 17 15:51:31.397705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': 'c0c47a31-9dc4-459c-aa92-3f64baacafd5'} May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 could not be found. May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:51:31.398558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 could not be found. May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 could not be found. May 17 15:51:31.399807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:51:31.400901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Returning 404 to user: Instance c0c47a31-9dc4-459c-aa92-3f64baacafd5 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:51:31.400901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9d148f91-ccbb-4df8-a6aa-59a52f60224b tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5" status: 404 len: 111 microversion: 2.1 time: 0.028750 May 17 15:51:31.400901 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 419/838] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:51:31 2022] GET /compute/v2.1/servers/c0c47a31-9dc4-459c-aa92-3f64baacafd5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:51:31.487994 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:31.488609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:31.494865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.495317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.496085 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.496530 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.575011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-03d050c8-a418-41ca-aa32-2c766315e906 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] Calling method '.version_select at 0x7f83f74a7280>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:31.592571 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-03d050c8-a418-41ca-aa32-2c766315e906 tempest-TestShelveInstance-1530482492 tempest-TestShelveInstance-1530482492-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1475883912" status: 202 len: 0 microversion: 2.1 time: 0.021333 May 17 15:51:31.593436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 420/839] 10.222.0.75 () {58 vars in 1253 bytes} [Tue May 17 15:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1475883912 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 15:51:31.648559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:31.656304 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:31.657793 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:31.659597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c0bb1bd2-abec-4978-b153-3eeeb5a0dbe1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1664 microversion: 2.20 time: 0.174992 May 17 15:51:31.660156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 420/840] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:31 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:31.677463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea0e72a4-ef37-4b9d-8b63-7e51e7066d34"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:31.678606 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:31.685218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.685676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.686493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:31.686936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:31.948798 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-659c5f01-95e0-420c-81b8-7f9ccc5031c6 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275391 May 17 15:51:31.949661 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 421/841] 10.222.0.75 () {62 vars in 1363 bytes} [Tue May 17 15:51:31 2022] POST /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 15:51:32.060676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:32.061294 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:32.067682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:32.068341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:32.069119 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:32.069561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:32.313082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-02b13f61-7d55-4e04-bdce-7e9313246443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-volume_attachments/ea0e72a4-ef37-4b9d-8b63-7e51e7066d34" status: 202 len: 0 microversion: 2.20 time: 0.256227 May 17 15:51:32.313888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 421/842] 10.222.0.75 () {60 vars in 1456 bytes} [Tue May 17 15:51:32 2022] DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-volume_attachments/ea0e72a4-ef37-4b9d-8b63-7e51e7066d34 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 15:51:32.369215 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:32.369793 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:32.375646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:32.376241 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:32.376866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:32.377308 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:32.468575 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0a219ca3-0dd7-48c1-9ed2-81e68b1d429e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "POST /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/action" status: 202 len: 0 microversion: 2.20 time: 0.103144 May 17 15:51:32.469496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 422/843] 10.222.0.75 () {62 vars in 1318 bytes} [Tue May 17 15:51:32 2022] POST /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 15:51:32.477958 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:32.478812 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:32.484949 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:32.485406 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:32.486223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:32.486667 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:32.662818 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:32.673102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:32.675692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:32.678379 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-60a17877-dc89-45a5-9d5c-d550fdfe5443 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1672 microversion: 2.20 time: 0.204564 May 17 15:51:32.679556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 422/844] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:32 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:33.696952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:33.697572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:33.704779 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:33.705548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:33.707021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:33.707461 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:34.011317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:34.019085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:34.020682 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:34.021906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-46b3921a-048c-4bc0-a612-9072caaee308 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.328831 May 17 15:51:34.022565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 423/845] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:33 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:35.040969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:35.041691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:35.050358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:35.051084 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:35.051971 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:35.052507 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:35.301524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:35.313763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:35.316712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:35.318382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-58653bb0-2258-4bbf-a05a-43cc0c4c3935 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.281396 May 17 15:51:35.331137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 423/846] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:35 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:36.339963 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:36.340668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:36.348083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:36.348518 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:36.350443 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:36.351148 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:36.498657 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:36.507705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:36.510129 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:36.511645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0267cbfd-801e-4cc1-9e4e-859e443ccf90 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.175553 May 17 15:51:36.512235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 424/847] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:36 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:37.533187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:37.537158 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:37.545917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:37.546977 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:37.548398 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:37.549003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:37.782144 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:37.792177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:37.793944 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:37.795562 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ae406782-3daf-4233-a136-382f40b04b11 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.268404 May 17 15:51:37.796772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 424/848] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:37 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:38.823838 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:38.837069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:38.845413 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:38.864883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:38.866168 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:38.866777 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:39.252120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:39.261499 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:39.263445 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:39.264720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ee4f0fbc-7be2-429d-bc06-e63c31c34b3a tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.444759 May 17 15:51:39.281251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 425/849] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:38 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:40.288530 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:40.289208 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:40.297389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:40.298426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:40.299272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:40.299876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:40.452007 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:40.461383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:40.463339 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:40.464779 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-30eacba6-20d1-4b4f-91d0-c2c6ec727fdf tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.180283 May 17 15:51:40.465886 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 425/850] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:40 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:41.483806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:41.484452 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:41.490910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:41.491458 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:41.492317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:41.492868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:41.626572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:41.635946 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:41.639370 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:41.642272 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-075b4c98-d9d6-4985-9b18-7b7df8c60122 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.160963 May 17 15:51:41.643776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 426/851] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:41 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:42.660894 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:42.661624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:42.668461 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:42.669290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:42.670181 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:42.670694 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:42.808319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:42.817067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:42.818597 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:42.819754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-94ca8a70-09e1-46b6-b2e7-700f174d01c0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.162838 May 17 15:51:42.820506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 426/852] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:42 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:43.837960 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:43.838715 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:43.845180 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:43.845625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:43.847047 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:43.847477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:43.993173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:44.002587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:44.004103 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:44.005261 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-900a759e-70b0-4bde-865a-8b64b1bd17ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.171254 May 17 15:51:44.005824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 427/853] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:43 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:45.023913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:45.024503 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:45.031904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:45.033046 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:45.034422 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:45.034851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:45.160708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:45.168386 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:45.169888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:45.171059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a192a5c7-b28e-4bc8-9981-ea0f10b8e4c2 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.151055 May 17 15:51:45.171612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 427/854] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:45 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:46.189224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:46.189836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:46.196178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:46.196620 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:46.197376 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:46.197807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:46.325239 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:46.332898 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:46.334417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:46.335560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-96fbf4e7-b36e-4ce4-9e8c-b9e852a1f2a9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.150280 May 17 15:51:46.336117 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 428/855] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:46 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:47.354449 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:47.355045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:47.361870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:47.362345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:47.363105 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:47.363536 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:47.488083 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:47.495856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:47.497352 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:47.498519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7816c5e2-3289-4fb8-8b8b-8a1125dbf7b9 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.148334 May 17 15:51:47.499085 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 428/856] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:47 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:48.517921 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:48.518500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:48.524979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:48.525432 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:48.526231 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:48.526676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:48.651263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:48.659501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:48.661005 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:48.662181 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9b66834c-d6da-486b-949d-a9e2898225f0 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.148385 May 17 15:51:48.666166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 429/857] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:48 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:49.680137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:49.680752 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:49.687122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:49.687579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:49.688344 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:49.688780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:49.818325 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:49.826066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:49.827599 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:49.828748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e903b148-b9be-4903-be2f-baabb8cbb3e1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.152550 May 17 15:51:49.829307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 429/858] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:49 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:50.847884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:50.848494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:50.855151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:50.855603 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:50.856371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:50.856842 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:50.982944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:50.990695 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:50.992192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:50.993340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-807453d1-6218-499e-8cd0-3f991a0da76d tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.149860 May 17 15:51:50.993912 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 430/859] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:50 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:52.011544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:52.012097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:52.018771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:52.019212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:52.020056 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:52.020517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:52.161624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:52.169290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:52.170814 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:52.171950 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-371b2e9d-fb01-45f8-b025-a3062a8dcd22 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.164429 May 17 15:51:52.172501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 430/860] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:52 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:53.191217 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:53.191836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:53.198182 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:53.198640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:53.199418 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:53.199860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:53.329668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:53.338148 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:53.339668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:53.340853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a7b15619-1b16-4ad3-ae2c-f1b2ad0a8101 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.154160 May 17 15:51:53.341425 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 431/861] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:53 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:53.490141 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-3a7ed698-405f-4978-8c15-9acf926c1b41 req-4ace57f0-dd36-47fe-804b-94fd90d0394c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "name": "network-vif-plugged", "status": "completed", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:51:53.500377 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-3a7ed698-405f-4978-8c15-9acf926c1b41 req-4ace57f0-dd36-47fe-804b-94fd90d0394c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:53.500823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-3a7ed698-405f-4978-8c15-9acf926c1b41 req-4ace57f0-dd36-47fe-804b-94fd90d0394c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:53.512736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-3a7ed698-405f-4978-8c15-9acf926c1b41 req-4ace57f0-dd36-47fe-804b-94fd90d0394c service nova] Creating event network-vif-plugged:3147fce3-6722-4f48-9760-c37ce1f654e6 for instance 0748c249-ac72-4f86-956e-d02cac507f75 on hv-cinder-84212 May 17 15:51:53.517686 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-3a7ed698-405f-4978-8c15-9acf926c1b41 req-4ace57f0-dd36-47fe-804b-94fd90d0394c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 May 17 15:51:53.518319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 431/862] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:51:54.359552 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:54.360170 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:54.366711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:54.367166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:54.367969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:54.368415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:54.686772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:54.695000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:54.696510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:54.697658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a5308910-4316-49db-9a8b-1e25679d42db tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.342057 May 17 15:51:54.698261 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 432/863] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:54 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:55.716769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:55.717583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:55.725021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:55.725472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:55.726279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:55.726712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:55.864624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:55.873328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:55.874858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:55.876137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-31a25bc8-9dc1-49cc-ba85-72cf4dcf3693 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1730 microversion: 2.20 time: 0.164024 May 17 15:51:55.877192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 432/864] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:55 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:51:56.896577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:51:56.897190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:51:56.903250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:56.903702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:56.904471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:51:56.904910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:51:57.030684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:57.038592 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:57.040114 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:51:57.041267 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8667af2e-9132-4956-89d7-83cf926b3ab1 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1717 microversion: 2.20 time: 0.149359 May 17 15:51:57.041833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 433/865] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:51:56 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1717 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:52:38.419250 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:38.419824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:38.428095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:38.428558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:38.429345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:38.429788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:38.455825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2679b56d-c3cc-4f3c-b661-199e928bcb65 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/ips" status: 200 len: 151 microversion: 2.1 time: 0.040914 May 17 15:52:38.456424 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 433/866] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:52:38 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:52:39.764683 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c07f2488-559b-47c9-9f7e-628d11aa9ea9"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:52:39.765827 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:39.771890 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:39.772343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:39.773105 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:39.773534 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:40.003121 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ef7b3368-b3d5-416c-a72a-cfc281d01240 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "POST /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242408 May 17 15:52:40.003725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 434/867] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:52:39 2022] POST /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:52:47.569091 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:47.569617 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:47.576452 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:47.576897 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:47.577661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:47.578127 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:47.749210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lazy-loading 'services' on Instance uuid 542eabc5-0397-4192-be08-167bb6e4ab75 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:52:47.817417 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2b07136d-6e42-4ee0-8476-5980284e2602 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments/c07f2488-559b-47c9-9f7e-628d11aa9ea9" status: 202 len: 0 microversion: 2.1 time: 0.252033 May 17 15:52:47.818244 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 434/868] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:52:47 2022] DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments/c07f2488-559b-47c9-9f7e-628d11aa9ea9 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:52:47.828155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:47.829263 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:47.835858 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:47.836357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:47.837230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:47.837671 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:47.871064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2247b58c-bc84-4962-a3a2-29600ccfba2b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047560 May 17 15:52:47.871628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 435/869] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:52:47 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:52:48.885572 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:48.886795 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:48.892966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:48.893410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:48.894200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:48.894632 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:48.922174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7650e61f-8d50-4345-812c-4a219bf2b00f tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042970 May 17 15:52:48.922717 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 435/870] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:52:48 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:52:48.978486 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:48.978999 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:48.985167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:48.985615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:48.986414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:48.986852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:49.011588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:52:49.082583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c7553cc7-c975-4e7c-a1fe-f85c1d191f21 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 204 len: 0 microversion: 2.1 time: 0.108114 May 17 15:52:49.083388 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 436/871] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:52:48 2022] DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:52:49.091856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:49.092466 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:49.098348 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:49.098794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:49.099549 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:49.099979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:49.224348 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:52:49.232427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d70af2b5-aeb7-468f-b7cb-a2d3739029a1 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1683 microversion: 2.1 time: 0.144378 May 17 15:52:49.232999 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 436/872] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:49 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:52:50.250029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:50.250721 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:50.257496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:50.257944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:50.258753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:50.259372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:50.398046 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:52:50.406022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dce79670-ea89-425b-902d-4240f0471a7e tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1683 microversion: 2.1 time: 0.160311 May 17 15:52:50.406616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 437/873] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:50 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:52:51.423918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:51.424535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:51.431382 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:51.431827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:51.432586 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:51.433022 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:51.928587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd099a8ecc77b4259aa30f227ae8f28ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b23dc4cf2a954ab8a64c81eac9080a70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:52:51.936012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8ce1400a-7059-4287-a247-b9dc5a7ecbb3 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 200 len: 1683 microversion: 2.1 time: 0.516107 May 17 15:52:51.936666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 437/874] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:51 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 1683 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:52:52.103685 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-2684cb26-d98c-441d-9cc6-1a188b90406f req-d3633a5b-34bb-4b79-aa5e-db1554f38d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542eabc5-0397-4192-be08-167bb6e4ab75", "name": "network-vif-deleted", "tag": "f52b50f9-a507-4651-8cf9-47e24b497db7"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:52:52.112070 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-2684cb26-d98c-441d-9cc6-1a188b90406f req-d3633a5b-34bb-4b79-aa5e-db1554f38d78 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:52.112512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-2684cb26-d98c-441d-9cc6-1a188b90406f req-d3633a5b-34bb-4b79-aa5e-db1554f38d78 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:52.123931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-2684cb26-d98c-441d-9cc6-1a188b90406f req-d3633a5b-34bb-4b79-aa5e-db1554f38d78 service nova] Creating event network-vif-deleted:f52b50f9-a507-4651-8cf9-47e24b497db7 for instance 542eabc5-0397-4192-be08-167bb6e4ab75 on hv-cinder-84212 May 17 15:52:52.129623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-2684cb26-d98c-441d-9cc6-1a188b90406f req-d3633a5b-34bb-4b79-aa5e-db1554f38d78 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029925 May 17 15:52:52.130519 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 438/875] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:52:52.953464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:52.954145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:52.960716 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:52.961174 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:52.961966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:52.962431 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:52.977161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 HTTP/1.1 May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:52:52.979114 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:52.980778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '542eabc5-0397-4192-be08-167bb6e4ab75'} May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:52.981608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:52.982969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:52.984142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:52.984142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-200eef89-37c4-41bd-8807-5317e75b8efb tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 404 len: 111 microversion: 2.1 time: 0.030930 May 17 15:52:52.984142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 438/876] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:52 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:52.990527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4270a69f-5c6f-4687-aa2e-38b1f5c86b9b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '.version_select at 0x7f840051a550>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:53.009264 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4270a69f-5c6f-4687-aa2e-38b1f5c86b9b tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939334892" status: 202 len: 0 microversion: 2.1 time: 0.022871 May 17 15:52:53.010178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 439/877] 10.222.0.75 () {58 vars in 1220 bytes} [Tue May 17 15:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939334892 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:52:54.717719 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:54.718248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:54.724619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:54.725077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:54.725848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:54.726309 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:54.740286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 HTTP/1.1 May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:52:54.741831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.743225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '542eabc5-0397-4192-be08-167bb6e4ab75'} May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:54.744031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.745532 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:54.747159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:54.747159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5c78b595-d4eb-42b4-b6b7-7478774d0a43 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 404 len: 111 microversion: 2.1 time: 0.029472 May 17 15:52:54.747159 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 439/878] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:52:54 2022] DELETE /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:54.751955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:54.752683 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 542eabc5-0397-4192-be08-167bb6e4ab75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:54.758919 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:54.759376 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:54.760211 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:54.760652 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:54.774936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 HTTP/1.1 May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:52:54.776546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.778137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '542eabc5-0397-4192-be08-167bb6e4ab75'} May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:54.779038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. May 17 15:52:54.780497 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:54.781815 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 542eabc5-0397-4192-be08-167bb6e4ab75 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:54.781815 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2ebba39a-c0cc-43a9-b423-8f11646178bd tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75" status: 404 len: 111 microversion: 2.1 time: 0.030250 May 17 15:52:54.781815 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 440/879] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:54 2022] GET /compute/v2.1/servers/542eabc5-0397-4192-be08-167bb6e4ab75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:55.906565 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:55.907074 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:55.913388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:55.913840 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:55.915142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:55.915620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:55.928778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 HTTP/1.1 May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:52:55.931036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.932587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '07336f08-accf-4aea-8682-5efa8f66d850'} May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:55.933619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.935082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:55.936612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:55.936612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-009f8970-99fd-4145-b5be-e5fcaa5c0971 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 404 len: 111 microversion: 2.1 time: 0.029677 May 17 15:52:55.936612 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 440/880] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:52:55 2022] DELETE /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:55.940629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:55.941238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 07336f08-accf-4aea-8682-5efa8f66d850] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:55.947548 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:55.947998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:55.948767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:55.949203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:55.963403 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 HTTP/1.1 May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:52:55.964899 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.966503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '07336f08-accf-4aea-8682-5efa8f66d850'} May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:55.967517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. May 17 15:52:55.969004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:55.970510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 07336f08-accf-4aea-8682-5efa8f66d850 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:55.970510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ad11d3d6-4c28-4a55-8a7e-8ddb15b6ff98 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850" status: 404 len: 111 microversion: 2.1 time: 0.029439 May 17 15:52:55.970510 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 441/881] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:55 2022] GET /compute/v2.1/servers/07336f08-accf-4aea-8682-5efa8f66d850 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:55.974652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:55.975151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:55.981754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:55.982248 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:55.983019 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:55.983513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:55.998695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 HTTP/1.1 May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:52:56.000192 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.001682 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '47ff22a4-3c47-4380-adb5-e6d21abbe224'} May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:56.002710 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.004177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:56.005828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:56.005828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f276d0ef-ced1-4405-bc1f-c33261859608 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 404 len: 111 microversion: 2.1 time: 0.030741 May 17 15:52:56.005828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 441/882] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:52:55 2022] DELETE /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:56.009611 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:56.010244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 47ff22a4-3c47-4380-adb5-e6d21abbe224] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:56.016030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:56.016475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:56.017225 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:56.017656 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:56.031249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 HTTP/1.1 May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:52:56.032719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.034233 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '47ff22a4-3c47-4380-adb5-e6d21abbe224'} May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:56.034975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. May 17 15:52:56.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:56.037232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 47ff22a4-3c47-4380-adb5-e6d21abbe224 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:56.037232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-20a615e6-604f-4ce7-9d9a-5f3778fd2e08 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224" status: 404 len: 111 microversion: 2.1 time: 0.028242 May 17 15:52:56.037232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 442/883] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:56 2022] GET /compute/v2.1/servers/47ff22a4-3c47-4380-adb5-e6d21abbe224 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:57.165804 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:57.166346 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:57.172823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:57.173277 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:57.174077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:57.174519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:57.187721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 HTTP/1.1 May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:52:57.189253 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.190777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '8ce6ee7f-d1fd-4950-b2b2-6504004d5e01'} May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:57.191652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.193305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:52:57.194781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:57.194781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e3c3e55a-1041-42e0-b79a-7a14bb279071 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 404 len: 111 microversion: 2.1 time: 0.028750 May 17 15:52:57.194781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 442/884] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:52:57 2022] DELETE /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:52:57.199442 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:52:57.200062 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] [instance: 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:52:57.206404 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:57.206861 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:57.207635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:52:57.208077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:52:57.222098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] HTTP exception thrown: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Request method failure captured: May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 HTTP/1.1 May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JPgEg6-jfoc-jNflj4yi0ZKNcyiaGB3RKGAOx5jimJ3HQgmers4ekkjxyLIKhGgH3J5UgJFCZSZ4zSCQC9L_ov6Gau8gr1jJq7BoFW5qLbCWnPWES9GfmT0Zs2Xj0IBQKIi94DC_-P19VGJuX_jLBDK9oT0X47_Y-UntmpM-uBgCs May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:52:57.223668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b23dc4cf2a954ab8a64c81eac9080a70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b23dc4cf2a954ab8a64c81eac9080a70"}]}] May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: b23dc4cf2a954ab8a64c81eac9080a70 May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1046646059 May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: d099a8ecc77b4259aa30f227ae8f28ad May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeNegativeTest-1046646059-project May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.225234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '8ce6ee7f-d1fd-4950-b2b2-6504004d5e01'} May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:52:57.226276 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. May 17 15:52:57.227727 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:52:57.229335 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] Returning 404 to user: Instance 8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:52:57.229335 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-73bc5697-6ed0-4c11-87e1-309ff1f55867 tempest-AttachVolumeNegativeTest-1046646059 tempest-AttachVolumeNegativeTest-1046646059-project] 10.222.0.75 "GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01" status: 404 len: 111 microversion: 2.1 time: 0.029827 May 17 15:52:57.229335 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 443/885] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:52:57 2022] GET /compute/v2.1/servers/8ce6ee7f-d1fd-4950-b2b2-6504004d5e01 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:53:02.034443 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:02.035568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:02.042598 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:02.043050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:02.043837 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:02.044359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:02.077189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a9424dc9-0e92-4e29-82d2-58ce6119c69f tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047697 May 17 15:53:02.077967 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 443/886] 10.222.0.75 () {60 vars in 1342 bytes} [Tue May 17 15:53:02 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:02.136244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:02.137005 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:02.147305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:02.147753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:02.148523 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:02.148955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:02.174417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:53:02.274733 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3b22fea8-b909-4dce-97dc-7602522f0d10 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 204 len: 0 microversion: 2.20 time: 0.141572 May 17 15:53:02.274733 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 444/887] 10.222.0.75 () {60 vars in 1279 bytes} [Tue May 17 15:53:02 2022] DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 15:53:02.283471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:02.284637 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:02.291802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:02.292256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:02.293036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:02.293475 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:02.427979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:02.436671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:02.438241 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:02.439645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ee99dce0-c79a-4c7f-9f88-8cbaf18722ad tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.160556 May 17 15:53:02.440229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 444/888] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:53:02 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:53:03.458400 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:03.459120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:03.465980 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:03.466474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:03.467294 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:03.467749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:03.593797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:03.603282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:03.604800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:03.605959 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f704bab1-03d9-4152-97c3-2932c7bc67ab tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1723 microversion: 2.20 time: 0.151862 May 17 15:53:03.606561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 445/889] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:53:03 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:53:04.624702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:04.625725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:04.632637 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:04.633097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:04.634619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:04.635234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:04.732846 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:04.747387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-7efc7fd7-6936-4d5d-943f-a825ea838e21 req-1b453705-75a7-4f4c-b850-1b1c92101b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0748c249-ac72-4f86-956e-d02cac507f75", "name": "network-vif-deleted", "tag": "3147fce3-6722-4f48-9760-c37ce1f654e6"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:53:04.765665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:04.783808 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e4972b781b043f69740342fde4efa73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf36f753be81486182665056a949849c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:04.786672 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-7efc7fd7-6936-4d5d-943f-a825ea838e21 req-1b453705-75a7-4f4c-b850-1b1c92101b2e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:04.787132 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-7efc7fd7-6936-4d5d-943f-a825ea838e21 req-1b453705-75a7-4f4c-b850-1b1c92101b2e service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:04.788912 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-13159388-a6aa-4033-8b82-39dd5f2e6121 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 200 len: 1655 microversion: 2.20 time: 0.168189 May 17 15:53:04.789747 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 445/890] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:53:04 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 15:53:04.839307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-7efc7fd7-6936-4d5d-943f-a825ea838e21 req-1b453705-75a7-4f4c-b850-1b1c92101b2e service nova] Creating event network-vif-deleted:3147fce3-6722-4f48-9760-c37ce1f654e6 for instance 0748c249-ac72-4f86-956e-d02cac507f75 on hv-cinder-84212 May 17 15:53:04.859610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-7efc7fd7-6936-4d5d-943f-a825ea838e21 req-1b453705-75a7-4f4c-b850-1b1c92101b2e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115652 May 17 15:53:04.860544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 446/891] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:53:05.807212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:05.807858 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:05.813898 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:05.814386 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:05.815151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:05.815588 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:05.829188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] HTTP exception thrown: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Request method failure captured: May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 HTTP/1.1 May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JJPQeMA1X4bO8ewBLTH9oUm01TYSF-Lve0S2NmVv30G36JR8lifLj_Kz6jWYwzY-sMvIHSfN8qdwPUhyyyhYRtsWXqOz0A0LIhJ3ZBTSFm2Vor508lrSjti2SrSrK5gNJna3JY8XiDpHhooJo1hPpy4DnIa1C4-hU9LELvH-k29XM May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Openstack-Nova-Api-Version: 2.20 May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: bf36f753be81486182665056a949849c May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:53:05.830736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bf36f753be81486182665056a949849c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bf36f753be81486182665056a949849c"}]}] May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: bf36f753be81486182665056a949849c May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 2e4972b781b043f69740342fde4efa73 May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:05.832395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '0748c249-ac72-4f86-956e-d02cac507f75'} May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:53:05.833209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:05.834464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:05.835556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Returning 404 to user: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:53:05.835556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-50bef27c-6633-4f07-a14a-ceced331349e tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 404 len: 111 microversion: 2.20 time: 0.029451 May 17 15:53:05.835556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 446/892] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:53:05 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 15:53:05.841372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9a237649-3e55-4248-bbab-476554155553 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '.version_select at 0x7f8400637820>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:05.858903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9a237649-3e55-4248-bbab-476554155553 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034974637" status: 204 len: 0 microversion: 2.20 time: 0.021600 May 17 15:53:05.859488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 447/893] 10.222.0.75 () {60 vars in 1261 bytes} [Tue May 17 15:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034974637 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 15:53:07.603704 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:07.604183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:07.610461 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:07.610909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:07.611660 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:07.612092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:07.626679 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] HTTP exception thrown: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Request method failure captured: May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 HTTP/1.1 May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JJPQeMA1X4bO8ewBLTH9oUm01TYSF-Lve0S2NmVv30G36JR8lifLj_Kz6jWYwzY-sMvIHSfN8qdwPUhyyyhYRtsWXqOz0A0LIhJ3ZBTSFm2Vor508lrSjti2SrSrK5gNJna3JY8XiDpHhooJo1hPpy4DnIa1C4-hU9LELvH-k29XM May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Openstack-Nova-Api-Version: 2.20 May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: bf36f753be81486182665056a949849c May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:53:07.628215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bf36f753be81486182665056a949849c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bf36f753be81486182665056a949849c"}]}] May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: bf36f753be81486182665056a949849c May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 2e4972b781b043f69740342fde4efa73 May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.629885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '0748c249-ac72-4f86-956e-d02cac507f75'} May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:53:07.630727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.631926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:07.633150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Returning 404 to user: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:53:07.633150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9d322053-5330-43fb-92da-01180f818b21 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 404 len: 111 microversion: 2.20 time: 0.030590 May 17 15:53:07.633150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 447/894] 10.222.0.75 () {60 vars in 1279 bytes} [Tue May 17 15:53:07 2022] DELETE /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 15:53:07.639209 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:07.639945 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 0748c249-ac72-4f86-956e-d02cac507f75] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:07.646821 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:07.647278 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:07.648116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:07.648501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:07.662204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] HTTP exception thrown: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Request method failure captured: May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 HTTP/1.1 May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JJPQeMA1X4bO8ewBLTH9oUm01TYSF-Lve0S2NmVv30G36JR8lifLj_Kz6jWYwzY-sMvIHSfN8qdwPUhyyyhYRtsWXqOz0A0LIhJ3ZBTSFm2Vor508lrSjti2SrSrK5gNJna3JY8XiDpHhooJo1hPpy4DnIa1C4-hU9LELvH-k29XM May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Openstack-Nova-Api-Version: 2.20 May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: bf36f753be81486182665056a949849c May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:53:07.663824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bf36f753be81486182665056a949849c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bf36f753be81486182665056a949849c"}]}] May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: bf36f753be81486182665056a949849c May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 2e4972b781b043f69740342fde4efa73 May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.665512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '0748c249-ac72-4f86-956e-d02cac507f75'} May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:53:07.666716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. May 17 15:53:07.668138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:07.669653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Returning 404 to user: Instance 0748c249-ac72-4f86-956e-d02cac507f75 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:53:07.669653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-563cb1fe-2328-4257-a02f-d55f1862aea7 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75" status: 404 len: 111 microversion: 2.20 time: 0.030499 May 17 15:53:07.669653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 448/895] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:53:07 2022] GET /compute/v2.1/servers/0748c249-ac72-4f86-956e-d02cac507f75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 15:53:08.794067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:08.794659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:08.801652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:08.802209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:08.803045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:08.803551 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:08.817200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] HTTP exception thrown: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Request method failure captured: May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 HTTP/1.1 May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8JJPQeMA1X4bO8ewBLTH9oUm01TYSF-Lve0S2NmVv30G36JR8lifLj_Kz6jWYwzY-sMvIHSfN8qdwPUhyyyhYRtsWXqOz0A0LIhJ3ZBTSFm2Vor508lrSjti2SrSrK5gNJna3JY8XiDpHhooJo1hPpy4DnIa1C4-hU9LELvH-k29XM May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Openstack-Nova-Api-Version: 2.20 May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: bf36f753be81486182665056a949849c May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:53:08.818870 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bf36f753be81486182665056a949849c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bf36f753be81486182665056a949849c"}]}] May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: bf36f753be81486182665056a949849c May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 2e4972b781b043f69740342fde4efa73 May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.820345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '4a13b9b5-8727-4b05-aa28-b74aad598788'} May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:53:08.821547 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.822951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:53:08.825049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Returning 404 to user: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:53:08.825049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d3f912a6-4db2-4c2c-8f30-d8e81a882375 tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 404 len: 111 microversion: 2.20 time: 0.031011 May 17 15:53:08.825049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 448/896] 10.222.0.75 () {60 vars in 1279 bytes} [Tue May 17 15:53:08 2022] DELETE /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 15:53:08.830654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:08.831268 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] [instance: 4a13b9b5-8727-4b05-aa28-b74aad598788] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:08.838242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:08.838702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:08.839485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:08.839944 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:08.854328 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] HTTP exception thrown: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Request method failure captured: May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 HTTP/1.1 May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8JJPQeMA1X4bO8ewBLTH9oUm01TYSF-Lve0S2NmVv30G36JR8lifLj_Kz6jWYwzY-sMvIHSfN8qdwPUhyyyhYRtsWXqOz0A0LIhJ3ZBTSFm2Vor508lrSjti2SrSrK5gNJna3JY8XiDpHhooJo1hPpy4DnIa1C4-hU9LELvH-k29XM May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Openstack-Nova-Api-Version: 2.20 May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: bf36f753be81486182665056a949849c May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:53:08.855965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_bf36f753be81486182665056a949849c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/bf36f753be81486182665056a949849c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/bf36f753be81486182665056a949849c"}]}] May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: bf36f753be81486182665056a949849c May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1193453340 May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 2e4972b781b043f69740342fde4efa73 May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1193453340-project May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.857479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '4a13b9b5-8727-4b05-aa28-b74aad598788'} May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:53:08.858258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. May 17 15:53:08.859457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:53:08.860653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] Returning 404 to user: Instance 4a13b9b5-8727-4b05-aa28-b74aad598788 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:53:08.860653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1b172d0e-3f20-4638-85cf-c3bf8b69261b tempest-AttachVolumeShelveTestJSON-1193453340 tempest-AttachVolumeShelveTestJSON-1193453340-project] 10.222.0.75 "GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788" status: 404 len: 111 microversion: 2.20 time: 0.030956 May 17 15:53:08.860653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 449/897] 10.222.0.75 () {60 vars in 1276 bytes} [Tue May 17 15:53:08 2022] GET /compute/v2.1/servers/4a13b9b5-8727-4b05-aa28-b74aad598788 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 15:53:17.503746 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4d5a4960-6fd8-4b2d-9dcd-cf60ab028302 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: .version_select at 0x7f83f72e1160>, body: {"keypair": {"name": "tempest-keypair-342100155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9qs45yz5B3sxpWWwa/VV6hqoAio7Q/Jun7tSrZ2NdZkauaylWylQz+SazI6C7DWkJt6RyrWsiBgZ88NuMwH+oBEs1Wm7+QkqqubM2MU/8G9x2CIoWG+K984uQ5Pc4W8Q=="}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:53:17.518406 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-4d5a4960-6fd8-4b2d-9dcd-cf60ab028302 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for project fabeead7b416455b8d93f9531f895ba4. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:53:17.522320 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-4d5a4960-6fd8-4b2d-9dcd-cf60ab028302 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for user 5a87409628484aa189c7dd44ee74344d and project fabeead7b416455b8d93f9531f895ba4. Resources: {'key_pairs'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:53:17.548883 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4d5a4960-6fd8-4b2d-9dcd-cf60ab028302 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.329931 May 17 15:53:17.549736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 449/898] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:53:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:53:19.098274 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1112087417", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "917a09a1-2bd7-4381-9dcc-06a916729d23"}], "security_groups": [{"name": "tempest-securitygroup--1243941836"}], "key_name": "tempest-keypair-342100155", "user_data": "}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:53:19.240193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] validate_networks() for [('917a09a1-2bd7-4381-9dcc-06a916729d23', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:53:19.674431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:53:19.675678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:53:19.676439 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:53:19.677305 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:53:19.677905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:53:19.691593 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:19.692275 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:19.693618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:19.694342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:19.711395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for project fabeead7b416455b8d93f9531f895ba4. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:53:19.716029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for user 5a87409628484aa189c7dd44ee74344d and project fabeead7b416455b8d93f9531f895ba4. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:53:19.728493 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:53:19.731088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:53:19.780709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-cf068b19-6d77-4325-a49a-ededb0fdb3c5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686585 May 17 15:53:19.781953 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 450/899] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:53:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:53:19.793896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e2a306cb-0a7c-4796-894a-cdfbfad0499c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:19.795133 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e2a306cb-0a7c-4796-894a-cdfbfad0499c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:19.859596 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e2a306cb-0a7c-4796-894a-cdfbfad0499c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:19.866867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e2a306cb-0a7c-4796-894a-cdfbfad0499c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1237 microversion: 2.1 time: 0.078581 May 17 15:53:19.868375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 450/900] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:19 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:20.893086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ebcec557-1cab-476a-9ada-8fa254fad24a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:20.893834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ebcec557-1cab-476a-9ada-8fa254fad24a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:20.968933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ebcec557-1cab-476a-9ada-8fa254fad24a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:20.976226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ebcec557-1cab-476a-9ada-8fa254fad24a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1237 microversion: 2.1 time: 0.093003 May 17 15:53:20.987055 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 451/901] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:20 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:21.993691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d8c60491-10ad-4625-bc72-545421948eeb tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:21.994427 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d8c60491-10ad-4625-bc72-545421948eeb tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:22.049163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d8c60491-10ad-4625-bc72-545421948eeb tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:22.055661 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d8c60491-10ad-4625-bc72-545421948eeb tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1237 microversion: 2.1 time: 0.066033 May 17 15:53:22.056227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 451/902] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:21 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:53:23.072140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f65b8cc6-cef2-493c-9300-b42854934520 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:23.072767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f65b8cc6-cef2-493c-9300-b42854934520 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:23.133108 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f65b8cc6-cef2-493c-9300-b42854934520 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:23.144663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f65b8cc6-cef2-493c-9300-b42854934520 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1237 microversion: 2.1 time: 0.072280 May 17 15:53:23.144663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 452/903] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:23 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:24.157434 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:24.158106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:24.165087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:24.165546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:24.166338 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:24.166783 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:24.227882 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:24.235658 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c3f5baac-cf51-4be9-b3f4-563774f4e585 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1241 microversion: 2.1 time: 0.081982 May 17 15:53:24.236956 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 452/904] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:24 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:25.253330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:25.253971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:25.262560 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:25.263176 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:25.264230 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:25.264866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:25.351796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:25.359453 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-51c1c295-0bae-4a41-96ff-ae1b903496a6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1295 microversion: 2.1 time: 0.110234 May 17 15:53:25.360058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 453/905] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:25 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1295 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:26.377256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:26.378393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:26.395284 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:26.396008 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:26.403022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:26.403484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:26.458899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-0b2d0895-89d1-4710-b51a-dd847675aeae req-a8c2f4a7-ded8-484d-819a-94c1cb5da981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e015bc8e-5811-406b-9e5c-76dff4966153", "tag": "e9a46791-512d-4556-80f5-15349d3449b9"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:53:26.478521 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-0b2d0895-89d1-4710-b51a-dd847675aeae req-a8c2f4a7-ded8-484d-819a-94c1cb5da981 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:26.478972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-0b2d0895-89d1-4710-b51a-dd847675aeae req-a8c2f4a7-ded8-484d-819a-94c1cb5da981 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:26.494769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-0b2d0895-89d1-4710-b51a-dd847675aeae req-a8c2f4a7-ded8-484d-819a-94c1cb5da981 service nova] Creating event network-changed:e9a46791-512d-4556-80f5-15349d3449b9 for instance e015bc8e-5811-406b-9e5c-76dff4966153 on hv-cinder-84212 May 17 15:53:26.500662 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-0b2d0895-89d1-4710-b51a-dd847675aeae req-a8c2f4a7-ded8-484d-819a-94c1cb5da981 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242794 May 17 15:53:26.501626 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 453/906] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:53:26.640414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:26.648407 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3d508567-4553-4865-9fb2-4303ccbdc6fa tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1363 microversion: 2.1 time: 0.275551 May 17 15:53:26.649590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 454/907] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:26 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:27.666903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:27.667605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:27.673628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:27.674138 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:27.674909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:27.675351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:27.810059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:27.817339 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e332f0f7-ed2c-473d-8439-fa0e7f2aa0d2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1363 microversion: 2.1 time: 0.155736 May 17 15:53:27.817915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 454/908] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:27 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:28.833770 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:28.834333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:28.840352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:28.840807 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:28.841584 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:28.842043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:29.043219 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:29.050398 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-24170268-6e9e-4d12-8d6f-789e25d0a1c8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1363 microversion: 2.1 time: 0.220711 May 17 15:53:29.050964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 455/909] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:28 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:30.067712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:30.068366 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:30.074861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:30.075317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:30.076088 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:30.076527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:30.214742 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:30.222628 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-64ba6c44-8357-40b4-b97c-b0354d0d798f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1363 microversion: 2.1 time: 0.158945 May 17 15:53:30.223210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 455/910] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:30 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:31.239855 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:31.240681 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:31.247710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:31.248243 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:31.249019 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:31.249460 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:31.650672 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:31.658295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-06dab4d7-9061-40de-856e-00c574c628f8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1363 microversion: 2.1 time: 0.422285 May 17 15:53:31.658865 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 456/911] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:31 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:31.908031 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-cecb2918-8a39-44eb-8263-50617b278306 req-2d8757be-9d6a-4935-b1fb-39f408af6a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e015bc8e-5811-406b-9e5c-76dff4966153", "name": "network-vif-plugged", "status": "completed", "tag": "e9a46791-512d-4556-80f5-15349d3449b9"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:53:31.918038 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-cecb2918-8a39-44eb-8263-50617b278306 req-2d8757be-9d6a-4935-b1fb-39f408af6a62 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:31.918726 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-cecb2918-8a39-44eb-8263-50617b278306 req-2d8757be-9d6a-4935-b1fb-39f408af6a62 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:31.930302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-cecb2918-8a39-44eb-8263-50617b278306 req-2d8757be-9d6a-4935-b1fb-39f408af6a62 service nova] Creating event network-vif-plugged:e9a46791-512d-4556-80f5-15349d3449b9 for instance e015bc8e-5811-406b-9e5c-76dff4966153 on hv-cinder-84212 May 17 15:53:31.935384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-cecb2918-8a39-44eb-8263-50617b278306 req-2d8757be-9d6a-4935-b1fb-39f408af6a62 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031159 May 17 15:53:31.936128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 456/912] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:53:32.675642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:32.676255 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:32.683079 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:32.683538 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:32.684302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:32.684749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:32.812361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:32.819618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-554be02d-e08a-4862-b4f5-b4d0e2eaee1a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1363 microversion: 2.1 time: 0.147893 May 17 15:53:32.820185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 457/913] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:32 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:53:33.837676 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:33.838559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:33.845035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:33.845823 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:33.846631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:33.847075 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:33.971910 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:53:33.979604 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3c20d60c-912b-409e-baa7-b5f82dffba95 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1548 microversion: 2.1 time: 0.147304 May 17 15:53:33.980173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 457/914] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:53:33 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:53:33.996234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:53:33.996725 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:53:34.003195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:34.003642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:34.004408 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:34.004842 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:34.078976 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-54db9349-3a5f-4d4f-8b5a-eb84402ae21f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086986 May 17 15:53:34.079568 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 458/915] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:53:33 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:53:34.965256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-86ea5d4c-3292-4ac9-929d-cb8bac461e45 req-0485e729-f5fd-49ce-8c0b-554e4d26905d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e015bc8e-5811-406b-9e5c-76dff4966153", "tag": "e9a46791-512d-4556-80f5-15349d3449b9"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:53:34.973799 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-86ea5d4c-3292-4ac9-929d-cb8bac461e45 req-0485e729-f5fd-49ce-8c0b-554e4d26905d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:53:34.974348 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-86ea5d4c-3292-4ac9-929d-cb8bac461e45 req-0485e729-f5fd-49ce-8c0b-554e4d26905d service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:53:34.985346 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-86ea5d4c-3292-4ac9-929d-cb8bac461e45 req-0485e729-f5fd-49ce-8c0b-554e4d26905d service nova] Creating event network-changed:e9a46791-512d-4556-80f5-15349d3449b9 for instance e015bc8e-5811-406b-9e5c-76dff4966153 on hv-cinder-84212 May 17 15:53:34.990122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-86ea5d4c-3292-4ac9-929d-cb8bac461e45 req-0485e729-f5fd-49ce-8c0b-554e4d26905d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028682 May 17 15:53:34.990781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 458/916] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:02.121860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8fd37cc0-b28e-4e39-92a6-bcc06eeec3aa tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Action: 'create', calling method: .version_select at 0x7f8400637ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1918482597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqNNhhQpdCYH73y1uBB2hv1CRB2amRxakxy3m9gHnBWjyd4/AX0q/Qv+ppstcu73+pp7FyTg3D/yx5XxWO9s2KK5mgYTRA5sRZrRyfTho8j7N1vYJ+pUnFtviYwhvIosQ=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:02.135650 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-8fd37cc0-b28e-4e39-92a6-bcc06eeec3aa tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Getting quotas for project 8636ddd509654ba48dc18dc2837ee0df. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:55:02.139341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-8fd37cc0-b28e-4e39-92a6-bcc06eeec3aa tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Getting quotas for user 4b5965b27f1b4ca38680e50363765387 and project 8636ddd509654ba48dc18dc2837ee0df. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:55:02.160063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8fd37cc0-b28e-4e39-92a6-bcc06eeec3aa tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043489 May 17 15:55:02.160687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 459/917] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:55:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:02.262770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1920901014", "imageRef": "67b1ce40-d292-4957-b529-7d49c7b45e61", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1918482597", "networks": [{"uuid": "8beab47e-2e89-4db1-91a7-7de315179ef3"}]}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:02.312456 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] validate_networks() for [('8beab47e-2e89-4db1-91a7-7de315179ef3', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:55:02.762262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:55:02.762691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:55:02.763167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:55:02.763582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:55:02.764903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:55:02.774090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:02.774730 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:02.775576 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:02.776014 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:02.792625 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Getting quotas for project 8636ddd509654ba48dc18dc2837ee0df. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:55:02.796531 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Getting quotas for user 4b5965b27f1b4ca38680e50363765387 and project 8636ddd509654ba48dc18dc2837ee0df. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:55:02.808011 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:55:02.810494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67b1ce40-d292-4957-b529-7d49c7b45e61',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:55:02.853828 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [2331af9b-6f28-4ed6-a0e6-b8db75ac6eb1] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 15:55:03.860822 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [2331af9b-6f28-4ed6-a0e6-b8db75ac6eb1] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 58028. May 17 15:55:03.865270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-56346ce0-c245-4bc8-8b83-3d600b315d5a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608225 May 17 15:55:03.866011 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 459/918] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:55:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:55:03.876680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-50aa9763-e489-464f-b9f6-c71366e30bb7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:03.877393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-50aa9763-e489-464f-b9f6-c71366e30bb7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:03.932674 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-50aa9763-e489-464f-b9f6-c71366e30bb7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:03.941069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-50aa9763-e489-464f-b9f6-c71366e30bb7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1259 microversion: 2.1 time: 0.068829 May 17 15:55:03.941768 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 460/919] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:03 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:04.958824 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:04.959594 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:04.966801 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:04.967327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:04.968388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:04.968833 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:05.040478 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:05.048520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9c747c8d-1674-4488-add8-0cf493e4009d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1329 microversion: 2.1 time: 0.094289 May 17 15:55:05.049006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 460/920] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:04 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1329 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:06.065310 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:06.066037 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:06.073319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:06.073771 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:06.074570 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:06.075005 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:06.214478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:06.223174 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-46e6ffde-75a8-462c-be41-6577af220a13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.162076 May 17 15:55:06.223772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 461/921] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:06 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:07.241687 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:07.242254 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:07.249030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:07.249484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:07.250282 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:07.250715 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:07.380084 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:07.387655 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-67f8e97c-a413-487f-b789-7390f3ae38f8 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.150033 May 17 15:55:07.388435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 461/922] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:07 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:07.735120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:07.736283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:07.742823 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:07.743283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:07.744068 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:07.744505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:07.768136 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-82d7b6c3-dafd-4cbd-b581-d0f09d459116 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/ips" status: 200 len: 145 microversion: 2.1 time: 0.037493 May 17 15:55:07.768726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 462/923] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:55:07 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:08.404359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:08.405008 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:08.411646 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:08.412099 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:08.413139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:08.413577 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:08.570861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:08.579139 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-813eb5df-a57e-4fe8-bfc0-3e26ca5561bb tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.178643 May 17 15:55:08.581230 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 462/924] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:08 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:09.596693 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:09.597319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:09.605585 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:09.606436 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:09.607281 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:09.607726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:09.738985 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:09.746809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e8f8ce3a-c913-4100-82c3-290a30eb2fb9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.154582 May 17 15:55:09.747600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 463/925] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:09 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:10.764338 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:10.765659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:10.772511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:10.772778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:10.773748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:10.774213 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:10.910802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:10.918456 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-194164ff-7970-422f-8285-ceb4301c3f7e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.157901 May 17 15:55:10.919030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 463/926] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:10 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:11.938837 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:11.939624 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:11.946104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:11.946565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:11.947352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:11.947791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:12.081125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:12.089051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8a8feab1-c571-4ef5-b4dd-cb26bfa33ff9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.153977 May 17 15:55:12.095090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 464/927] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:11 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:12.535741 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99695132-77db-48ee-ba75-fda5f091e2ce"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:12.537549 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:12.545467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:12.546584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:12.547003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:12.547527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:13.107995 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:13.109286 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:13.115787 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:13.116234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:13.117202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:13.117884 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:13.260841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:13.269086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1c23cadf-9378-4f7d-a388-8047a022df8e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.166166 May 17 15:55:13.269926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 465/928] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:13 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:14.285406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:14.286079 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:14.292412 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:14.292866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:14.293644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:14.294116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:14.422387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:14.429606 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-185efa7a-62a3-4e93-b7d0-de1f94e50713 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.148025 May 17 15:55:14.430236 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 466/929] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:14 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:15.446142 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:15.446790 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:15.453552 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:15.454017 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:15.454799 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:15.455235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:15.578374 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:15.585772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a1eea2f9-7cb2-468c-a8f4-d2d88df3c008 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.143518 May 17 15:55:15.586381 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 467/930] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:15 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:16.606462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:16.607130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:16.613426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:16.613876 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:16.614673 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:16.615120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:16.740373 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:16.747567 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2b4e19e0-a632-40ff-81fb-cd9f8802e59b tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.145256 May 17 15:55:16.748626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 468/931] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:16 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:17.359983 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-258a6b06-3bf7-4ee0-a4ee-4a0569690ca7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.828845 May 17 15:55:17.360791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 464/932] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:55:12 2022] POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-volume_attachments => generated 194 bytes in 4831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:17.765204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:17.765948 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:17.772596 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:17.773109 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:17.773909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:17.774449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:18.051928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:18.059966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1d9569d3-2de8-4878-b632-073c72c94674 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.299112 May 17 15:55:18.060955 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 469/933] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:17 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:18.634374 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-37f23c8b-7657-4e41-a138-b7ac8e8d7057 req-15c90686-56f5-4781-8cd2-801a71f03d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:18.643436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-37f23c8b-7657-4e41-a138-b7ac8e8d7057 req-15c90686-56f5-4781-8cd2-801a71f03d94 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:18.643888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-37f23c8b-7657-4e41-a138-b7ac8e8d7057 req-15c90686-56f5-4781-8cd2-801a71f03d94 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:18.662746 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-37f23c8b-7657-4e41-a138-b7ac8e8d7057 req-15c90686-56f5-4781-8cd2-801a71f03d94 service nova] Creating event network-changed:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:55:18.668074 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-37f23c8b-7657-4e41-a138-b7ac8e8d7057 req-15c90686-56f5-4781-8cd2-801a71f03d94 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 May 17 15:55:18.668683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 465/934] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:19.077172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:19.077818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:19.084532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:19.084989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:19.085761 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:19.086234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:19.260351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:19.269665 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-028beccd-33bf-4f15-bf18-6772b56a0b98 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.196173 May 17 15:55:19.270662 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 470/935] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:19 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:20.288350 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:20.289113 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:20.295298 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:20.296383 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:20.297152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:20.297587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:20.423368 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:20.430765 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-651fdce5-b4e7-455f-a975-235ab3d5a650 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.147059 May 17 15:55:20.431331 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 466/936] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:20 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:21.447467 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:21.448086 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:21.455090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:21.455546 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:21.456322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:21.456762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:21.589629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:21.597628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-77375012-bda4-4199-bf00-eb1675f904b2 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.154006 May 17 15:55:21.598232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 471/937] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:21 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:22.615140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:22.615809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:22.622258 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:22.622702 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:22.623467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:22.623926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:22.752156 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:22.759539 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-30a1c9be-d72c-4563-bd6e-204f06277c33 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.148159 May 17 15:55:22.760109 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 467/938] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:22 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:23.780368 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:23.780964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:23.788873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:23.789333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:23.790137 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:23.790577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:23.923769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:23.932190 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9d8f0e3f-0071-4467-9e08-2960235f71d7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.155840 May 17 15:55:23.932765 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 472/939] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:23 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:24.856872 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9dd8d1ca-70cd-4f8c-893d-72a1d15b2f52 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:24.863951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9dd8d1ca-70cd-4f8c-893d-72a1d15b2f52 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:24.864402 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9dd8d1ca-70cd-4f8c-893d-72a1d15b2f52 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:24.926170 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9dd8d1ca-70cd-4f8c-893d-72a1d15b2f52 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Going to try to stop instance {{(pid=123908) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 15:55:24.949213 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:24.949828 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:24.962397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:24.962878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:24.963797 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:24.964238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:24.970555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9dd8d1ca-70cd-4f8c-893d-72a1d15b2f52 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action" status: 202 len: 0 microversion: 2.1 time: 0.117504 May 17 15:55:24.971176 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 468/940] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:55:24 2022] POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:55:24.980053 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:24.980909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:24.987777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:24.988273 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:24.989307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:24.989913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:25.164739 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:25.168151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:25.172509 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7170141c-f0bd-4252-970c-58c9588c41ea tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.227049 May 17 15:55:25.173096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 473/941] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:24 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:25.176290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-07a81e55-3d4a-4481-988c-f85541b03b63 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.200720 May 17 15:55:25.176936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 469/942] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:24 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:26.189654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:26.190297 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:26.193507 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:26.194153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:26.196843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:26.197292 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:26.198096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:26.198532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:26.200439 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:26.200890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:26.202199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:26.202643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:26.390941 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:26.394685 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:26.398717 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8fb30bc4-635d-49f8-9d91-e8679e51da8d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.212822 May 17 15:55:26.399124 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 474/943] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:26 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:26.402663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0f5f933f-7fe5-424b-a994-1cd86c2a0359 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.212888 May 17 15:55:26.403228 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 470/944] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:26 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:26.602730 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "name": "network-vif-plugged", "status": "completed", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:26.611622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:26.612065 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:26.622909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] Creating event network-vif-plugged:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:55:26.626430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR oslo.messaging._drivers.impl_rabbit [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] [6813a23a-89b4-4f05-a5a9-f2c812bd374c] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 15:55:27.414669 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:27.415278 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:27.421553 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:27.422020 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:27.422800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:27.423235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:27.551005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:27.558189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4b2a55a7-b31d-4841-8671-9459150b6b14 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.147309 May 17 15:55:27.558749 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 471/945] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:27 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:27.562995 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:27.563590 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:27.568965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:27.569410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:27.570200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:27.570638 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:27.633931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] [6813a23a-89b4-4f05-a5a9-f2c812bd374c] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 58168. May 17 15:55:27.637465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-ab0d7ccd-165a-4b66-91e7-34dac42e3e21 req-c5cdfdfb-a94d-46b5-a051-1826d71d5ab9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.158068 May 17 15:55:27.638096 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 475/946] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:27.706094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:27.714217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bb053b50-bbf0-496e-b1f7-71978e78400c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.154491 May 17 15:55:27.714797 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 472/947] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:27 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:28.576514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:28.577150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:28.583476 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:28.583934 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:28.584709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:28.585151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:28.708532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:28.715795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-09094cdc-732c-415b-876e-a4f887cf0a3e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1359 microversion: 2.1 time: 0.144249 May 17 15:55:28.716371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 476/948] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:28 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:55:28.732722 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:28.733955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:28.740319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:28.740772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:28.741534 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:28.741972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:28.867492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:28.875206 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0d472190-2f05-4ba3-9237-40e9c26d6f49 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.146560 May 17 15:55:28.876022 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 473/949] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:28 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:29.732341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:29.732961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:29.739814 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:29.740280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:29.741130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:29.741572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:29.872151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:29.880121 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ad5c1278-24ff-4885-831f-f0712d15d4ac tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1548 microversion: 2.1 time: 0.151958 May 17 15:55:29.880688 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 477/950] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:29 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:29.892424 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:29.893152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:29.895702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:29.896326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:29.899636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:29.900092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:29.900867 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:29.901305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:29.902056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:29.902514 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:29.903456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:29.903906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:30.087601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:30.090916 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:30.096476 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-62430340-753f-4aab-968d-cdb1f1e96ec7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1548 microversion: 2.1 time: 0.204225 May 17 15:55:30.097397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 478/951] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:29 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:30.100821 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1b476b12-4b49-4dfe-899f-4af0b24e8991 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.212089 May 17 15:55:30.101421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 474/952] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:29 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:30.112571 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:30.115951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:30.116709 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Searching by: {'deleted': False, 'project_id': '8636ddd509654ba48dc18dc2837ee0df'} {{(pid=123909) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 15:55:30.123160 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:30.123612 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:30.124422 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:30.124860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:30.215372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.multi_cell_list [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123909) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 15:55:30.308077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7e2d64c3-a696-47f0-ab56-ea57ee35acce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199564 May 17 15:55:30.308578 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 479/953] 10.222.0.75 () {58 vars in 1124 bytes} [Tue May 17 15:55:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:30.318623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:30.319240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:30.325306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:30.325751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:30.326540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:30.326975 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:30.453495 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:30.460771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9326002a-e63b-4f89-ae3f-4b9ccd070c68 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1548 microversion: 2.1 time: 0.145953 May 17 15:55:30.461336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 475/954] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:30 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:31.118829 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:31.119440 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:31.125808 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:31.126283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:31.127051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:31.127488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:31.251130 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:31.259043 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-be3470a1-fd11-4309-b31a-fb938f9e2c4e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.144007 May 17 15:55:31.259631 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 480/955] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:31 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:31.949533 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "428f6990-0bc2-4af1-9f3b-6d87c9a35866"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:31.950666 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:31.957600 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:31.958081 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:31.958856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:31.959294 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:32.191534 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-503b3bc6-3d10-4e8e-839d-61f700594839 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245695 May 17 15:55:32.196450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 476/956] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:55:31 2022] POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:32.276455 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:32.277100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:32.283825 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:32.284339 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:32.285186 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:32.285691 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:32.419802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:32.428303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d6c13f0d-4b8c-42af-bf50-e75975d7e5a3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.155513 May 17 15:55:32.428966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 481/957] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:32 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:33.446118 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:33.446825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:33.453929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:33.454408 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:33.455173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:33.455613 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:33.579932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:33.588188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cf81fc4a-69ab-4caf-be6c-50091142cec7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.146405 May 17 15:55:33.588761 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 477/958] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:33 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:34.609836 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:34.610477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:34.616817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:34.617271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:34.618069 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:34.618511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:34.905475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:34.913238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1e376e0b-4c67-44a1-9d66-10c55f097be0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1723 microversion: 2.1 time: 0.307226 May 17 15:55:34.914193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 482/959] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:34 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:35.930988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:35.931624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:35.937920 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:35.938399 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:35.939166 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:35.939603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:36.064014 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:36.072106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4d5802ec-c5ff-440b-a186-a692f3ad9ff5 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1700 microversion: 2.1 time: 0.144739 May 17 15:55:36.072417 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 478/960] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:35 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1700 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:36.088754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-61b37ae1-6692-442b-b070-d4688ef40735 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:36.095262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61b37ae1-6692-442b-b070-d4688ef40735 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:36.095729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61b37ae1-6692-442b-b070-d4688ef40735 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:36.155185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-61b37ae1-6692-442b-b070-d4688ef40735 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Going to try to start instance {{(pid=123909) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 15:55:36.197601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-61b37ae1-6692-442b-b070-d4688ef40735 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action" status: 202 len: 0 microversion: 2.1 time: 0.112652 May 17 15:55:36.198166 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 483/961] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:55:36 2022] POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:55:36.208243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:36.208857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:36.215328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:36.215794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:36.216578 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:36.217341 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:36.376183 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:36.383978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5b93554c-e3f4-43ad-8a23-335ccc8dd223 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1709 microversion: 2.1 time: 0.179981 May 17 15:55:36.384563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 479/962] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:36 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1709 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:37.402489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:37.403968 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:37.410738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:37.411413 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:37.412204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:37.412823 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:37.548421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:37.556288 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4ccdedc7-22f5-46ef-b1fb-f8d46d230ced tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1713 microversion: 2.1 time: 0.158651 May 17 15:55:37.556852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 484/963] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:37 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1713 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:39.716123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:39.716742 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:39.723127 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:39.723582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:39.724579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:39.725019 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:39.849639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:39.859048 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-eb21580c-8d11-4394-b5d1-c546bb2a72a4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1594 microversion: 2.1 time: 0.146173 May 17 15:55:39.859972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 480/964] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:39 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1594 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:55:41.540658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-7827228a-ef6f-4f42-a92b-b93efeb6ef5f req-4b1ee7a8-dfd3-446f-896c-9aad20774076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:41.550471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-7827228a-ef6f-4f42-a92b-b93efeb6ef5f req-4b1ee7a8-dfd3-446f-896c-9aad20774076 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:41.551140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-7827228a-ef6f-4f42-a92b-b93efeb6ef5f req-4b1ee7a8-dfd3-446f-896c-9aad20774076 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:41.564341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-7827228a-ef6f-4f42-a92b-b93efeb6ef5f req-4b1ee7a8-dfd3-446f-896c-9aad20774076 service nova] Creating event network-changed:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:55:41.569822 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-7827228a-ef6f-4f42-a92b-b93efeb6ef5f req-4b1ee7a8-dfd3-446f-896c-9aad20774076 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115693 May 17 15:55:41.570856 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 485/965] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:42.513145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1998344387"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:42.513695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:42.520587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:42.522110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:42.522110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:42.522461 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:42.649327 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.network.security_group_api [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Adding security group e9c97620-f6e4-4529-aa34-6d0aa365bd65 to port 09580395-7ff8-4876-a686-2b6cb4a99304 May 17 15:55:43.023189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0dfd063f-b3e2-40d4-93f2-9f83e1931052 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/action" status: 202 len: 0 microversion: 2.1 time: 0.513894 May 17 15:55:43.024212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 481/966] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:55:42 2022] POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 15:55:43.036349 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:55:43.039845 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:55:43.044117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-5cfa342c-407d-495c-9f16-b2b007794651 req-5802e9e3-21fc-4371-a951-41fc36615ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:55:43.060054 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:43.063406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:43.064506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:43.065769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:43.067769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-5cfa342c-407d-495c-9f16-b2b007794651 req-5802e9e3-21fc-4371-a951-41fc36615ee3 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:55:43.071450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-5cfa342c-407d-495c-9f16-b2b007794651 req-5802e9e3-21fc-4371-a951-41fc36615ee3 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:55:43.089934 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-5cfa342c-407d-495c-9f16-b2b007794651 req-5802e9e3-21fc-4371-a951-41fc36615ee3 service nova] Creating event network-changed:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:55:43.100254 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-5cfa342c-407d-495c-9f16-b2b007794651 req-5802e9e3-21fc-4371-a951-41fc36615ee3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066087 May 17 15:55:43.101070 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 482/967] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:55:43.324152 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:55:43.332678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-26a7993c-736f-4b3a-a085-03042811989e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1760 microversion: 2.1 time: 0.302889 May 17 15:55:43.333935 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 486/968] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:55:43 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1760 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:40.955720 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:40.956302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:40.962450 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:40.962905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:40.963665 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:40.964102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:41.041129 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lazy-loading 'services' on Instance uuid e015bc8e-5811-406b-9e5c-76dff4966153 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:56:41.111251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-738e183a-2a10-4d74-8d0c-9846fbf5bd16 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-volume_attachments/99695132-77db-48ee-ba75-fda5f091e2ce" status: 202 len: 0 microversion: 2.1 time: 0.159834 May 17 15:56:41.111981 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 483/969] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:56:40 2022] DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-volume_attachments/99695132-77db-48ee-ba75-fda5f091e2ce => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:56:42.220381 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-378032b0-cdbf-4393-a94f-d0e23be462b0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:56:42.226605 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-378032b0-cdbf-4393-a94f-d0e23be462b0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:42.227057 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-378032b0-cdbf-4393-a94f-d0e23be462b0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:42.249167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-378032b0-cdbf-4393-a94f-d0e23be462b0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Going to try to stop instance {{(pid=123909) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 15:56:42.290658 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-378032b0-cdbf-4393-a94f-d0e23be462b0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action" status: 202 len: 0 microversion: 2.1 time: 0.073927 May 17 15:56:42.291431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 487/970] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:56:42 2022] POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:56:42.301457 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:42.302276 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:42.310284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:42.310740 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:42.311529 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:42.311973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:42.443803 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:42.451323 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cc798283-2b6b-4d0f-acc9-611da448d215 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.155585 May 17 15:56:42.451890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 484/971] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:42 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:43.471767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:43.472474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:43.478702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:43.479156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:43.479937 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:43.480633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:43.605754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:43.613156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d965715e-f712-486c-8580-e668693d58c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.146813 May 17 15:56:43.613720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 488/972] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:43 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:44.632713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:44.633332 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:44.641603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:44.642078 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:44.643014 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:44.643311 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:44.775579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:44.783357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cc9ce924-a62b-40b6-a3a1-f4f5ba635c1e tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.156480 May 17 15:56:44.783922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 485/973] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:44 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:45.800450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:45.801075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:45.807512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:45.807971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:45.808754 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:45.809203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:45.933394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:45.941636 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f19c4b70-9989-4648-8ad1-7f96bf46ea3d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.145584 May 17 15:56:45.942232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 489/974] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:45 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:46.958770 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:46.959380 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:46.965722 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:46.966209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:46.966969 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:46.967405 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:47.094750 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:47.102097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-06c92503-f891-4a32-b08d-0992d1669ae4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.147139 May 17 15:56:47.102664 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 486/975] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:46 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:48.120045 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:48.120654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:48.127545 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:48.128000 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:48.128760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:48.129195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:48.257338 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:48.264663 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9803521c-03a8-4987-8451-3bed98b27101 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.148549 May 17 15:56:48.265220 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 490/976] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:48 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:49.281391 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:49.281939 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:49.288303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:49.288758 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:49.289527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:49.289968 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:49.420356 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:49.428074 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3a2c73ed-3202-45ec-8f14-3384f108b3e6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.150626 May 17 15:56:49.428632 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 487/977] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:49 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:50.446051 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:50.446621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:50.453366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:50.453810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:50.454600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:50.455036 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:50.581909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:50.589273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7e92c21c-ed17-42c2-9e3d-498abf05b786 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.147204 May 17 15:56:50.589833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 491/978] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:50 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:51.606753 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:51.607362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:51.614223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:51.614677 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:51.615437 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:51.615873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:51.743736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:51.751454 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-beb4e5d6-3903-49ce-91a6-6e3d8498a2dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.148674 May 17 15:56:51.757032 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 488/979] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:51 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:52.769265 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:52.769931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:52.776538 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:52.776994 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:52.777809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:52.778326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:52.908873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:52.916336 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d59dba68-bb3c-47b4-89df-a01c740a555b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.151589 May 17 15:56:52.916891 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 492/980] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:52 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:53.933400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:53.934189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:53.941093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:53.941552 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:53.942354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:53.942796 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:54.068490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:54.075819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e6000035-3d55-4954-9855-0b442edd5df4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.146298 May 17 15:56:54.076388 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 489/981] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:53 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:54.352624 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:56:54.353561 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:54.360811 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:54.361269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:54.362196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:54.362635 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:54.434529 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7346e3de-3e9c-4b0b-ad5a-e0ffb3253d16 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/action" status: 202 len: 0 microversion: 2.1 time: 0.085658 May 17 15:56:54.435221 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 493/982] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:56:54 2022] POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:56:54.444262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:54.444878 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:54.451360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:54.451799 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:54.452576 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:54.453003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:54.681306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:54.689880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e8b12349-58e0-4880-8728-677e66e2de90 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1752 microversion: 2.1 time: 0.249856 May 17 15:56:54.690488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 490/983] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:54 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1752 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:55.101989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:55.102720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:55.109075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:55.109536 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:55.111011 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:55.111456 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:55.552250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:55.559593 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-39d338cb-ba2f-4b16-af90-52170d4e9466 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.461899 May 17 15:56:55.560151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 494/984] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:55 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:55.707596 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:55.708211 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:55.714590 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:55.715043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:55.715843 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:55.716284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:55.853286 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:55.862009 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9befeddb-94b9-473f-aa2e-d7023782715e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.158825 May 17 15:56:55.862581 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 491/985] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:55 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:56.576752 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:56.577295 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:56.583676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:56.584136 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:56.584916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:56.585359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:56.712439 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:56.720292 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-16c2a629-630c-4f7e-ab69-c004fa5b0e17 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.147520 May 17 15:56:56.720860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 495/986] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:56 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:56.879484 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:56.880793 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:56.887358 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:56.887798 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:56.888559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:56.889045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:57.027179 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:57.035588 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-df590baf-e38e-436b-b47a-8f04fbc725af tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.160017 May 17 15:56:57.036172 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 492/987] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:56 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:57.737943 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:57.738590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:57.744558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:57.745014 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:57.745769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:57.746237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:57.875035 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:57.883102 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-15ada33e-3541-4d7a-a46a-a0473013a6dd tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.149555 May 17 15:56:57.883668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 496/988] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:57 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:58.052464 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:58.053007 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:58.059424 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:58.059918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:58.060695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:58.061155 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:58.197125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:58.205544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-564be753-199e-418d-9c43-5ea787a3302a tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.156972 May 17 15:56:58.206140 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 493/989] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:58 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:58.900348 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:58.900968 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:58.907342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:58.907800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:58.908577 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:58.909023 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:59.037750 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:59.045102 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a847b3d1-8219-4329-8980-bc275df02015 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.148749 May 17 15:56:59.045667 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 497/990] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:58 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:56:59.222429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:56:59.222973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:56:59.229221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:59.229663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:59.230718 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:56:59.231153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:56:59.367569 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:56:59.376274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-656fb2bf-61f6-4356-b54b-e4d375847bce tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.157049 May 17 15:56:59.376895 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 494/991] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:56:59 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:00.062580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:00.063191 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:00.070129 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:00.070594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:00.071370 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:00.071817 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:00.203158 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:00.211042 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c4af5de0-1b7b-42ee-bee0-b9f5ca8583c7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.152263 May 17 15:57:00.211634 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 498/992] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:00 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:00.392598 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:00.393214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:00.399691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:00.400145 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:00.400917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:00.401355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:00.548112 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:00.556510 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a7b40a9c-ff4f-4dfa-9ece-94a65ed957c7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.167830 May 17 15:57:00.557160 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 495/993] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:00 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:01.229027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:01.229617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:01.236922 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:01.237387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:01.238199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:01.238648 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:01.361928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:01.369726 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e36a2f45-9149-4562-8420-256b87df38d4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.144666 May 17 15:57:01.370340 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 499/994] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:01 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:01.572655 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:01.573193 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:01.579448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:01.579890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:01.581137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:01.581565 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:01.720312 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:01.728571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2e0687b1-80ef-4594-97e9-f577cdf10bd4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.159852 May 17 15:57:01.729128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 496/995] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:01 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:02.386616 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:02.387245 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:02.393572 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:02.394057 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:02.394835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:02.395281 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:02.534873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:02.542226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a87583d1-421f-4500-8e89-3ec4954d890d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1677 microversion: 2.1 time: 0.159427 May 17 15:57:02.542794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 500/996] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:02 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:02.745878 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:02.746471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:02.753012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:02.753483 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:02.754324 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:02.754830 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:02.897354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:02.905071 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a95e0857-5b8f-448a-af97-5d1e528696d9 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.163167 May 17 15:57:02.905638 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 497/997] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:02 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:57:03.559959 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:03.560569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:03.567360 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.567837 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:03.568626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.569063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:03.693494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:03.700961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6a81429e-1158-4e4b-8a7a-f568d526fc75 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1654 microversion: 2.1 time: 0.144853 May 17 15:57:03.701474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 501/998] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:03 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1654 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:03.717062 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bde046fd-2d77-4ebf-a699-5d8ac257e6e7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:57:03.722964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bde046fd-2d77-4ebf-a699-5d8ac257e6e7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.723416 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bde046fd-2d77-4ebf-a699-5d8ac257e6e7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:03.745178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-bde046fd-2d77-4ebf-a699-5d8ac257e6e7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Going to try to start instance {{(pid=123908) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 15:57:03.787006 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bde046fd-2d77-4ebf-a699-5d8ac257e6e7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action" status: 202 len: 0 microversion: 2.1 time: 0.073542 May 17 15:57:03.787673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 498/999] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:57:03 2022] POST /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:57:03.795794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:03.796414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:03.803729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.804333 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:03.805256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.805705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:03.922805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:03.923506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:03.930208 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.930657 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:03.931428 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:03.931864 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:04.049719 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:04.057120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-05459fc5-0632-4550-9256-17e25f68f5b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1663 microversion: 2.1 time: 0.265232 May 17 15:57:04.057689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 502/1000] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:03 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1663 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:04.174723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:04.182679 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-67418a30-f7da-4043-b5d0-deb502e210a7 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.264008 May 17 15:57:04.183256 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 499/1001] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:03 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:57:05.074707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:05.075344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:05.082375 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:05.082841 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:05.083623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:05.084076 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:05.199678 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:05.200287 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:05.206245 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:05.206692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:05.207451 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:05.207880 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:05.216049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:05.223626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0f59d115-8287-49a3-bf72-e0f4220edbcf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1663 microversion: 2.1 time: 0.152999 May 17 15:57:05.224198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 503/1002] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:05 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:05.358316 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:05.366640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bd2876d7-4944-42a0-a4cd-31ca1fe83b4d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1757 microversion: 2.1 time: 0.170837 May 17 15:57:05.367214 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 500/1003] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:05 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:57:06.240584 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:06.241270 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:06.247748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:06.248209 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:06.248989 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:06.249431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:06.376278 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:06.384347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c072f18f-4b41-4258-bcf8-b2e7bcf2fe48 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1667 microversion: 2.1 time: 0.147604 May 17 15:57:06.384506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:57:06.384973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 504/1004] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:06 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:57:06.385073 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:57:06.391219 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:06.391669 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:06.392492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:57:06.393421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:57:06.536349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:57:06.544110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-23875cb3-b366-440b-8899-b4069c13c717 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1760 microversion: 2.1 time: 0.163505 May 17 15:57:06.544681 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 501/1005] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:57:06 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:58:04.889770 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1998344387"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:04.890428 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:04.897072 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:04.897527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:04.898330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:04.898771 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:05.026906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.network.security_group_api [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Removing security group e9c97620-f6e4-4529-aa34-6d0aa365bd65 from port 09580395-7ff8-4876-a686-2b6cb4a99304 May 17 15:58:05.386139 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-55cda3e8-7872-4d6e-9f43-016b586ffd69 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/action" status: 202 len: 0 microversion: 2.1 time: 0.500494 May 17 15:58:05.396501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-cd44c645-20ce-4da9-bb86-dd0e4cc39df3 req-8274b121-a7da-48df-bda6-510a84588b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:05.402430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 505/1006] 10.222.0.75 () {60 vars in 1277 bytes} [Tue May 17 15:58:04 2022] POST /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:58:05.408336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-cd44c645-20ce-4da9-bb86-dd0e4cc39df3 req-8274b121-a7da-48df-bda6-510a84588b50 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:05.409122 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-cd44c645-20ce-4da9-bb86-dd0e4cc39df3 req-8274b121-a7da-48df-bda6-510a84588b50 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:05.451987 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-cd44c645-20ce-4da9-bb86-dd0e4cc39df3 req-8274b121-a7da-48df-bda6-510a84588b50 service nova] Creating event network-changed:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:58:05.459293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-cd44c645-20ce-4da9-bb86-dd0e4cc39df3 req-8274b121-a7da-48df-bda6-510a84588b50 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067435 May 17 15:58:05.463859 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 502/1007] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:58:06.737164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:06.737653 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:06.743927 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:06.744378 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:06.745189 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:06.745619 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:06.827145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lazy-loading 'services' on Instance uuid 16da988b-84bf-434d-8672-8e64763bec13 {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 15:58:06.944090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d9b6bee5-036e-4bd4-ad21-d067e90ccf82 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments/428f6990-0bc2-4af1-9f3b-6d87c9a35866" status: 202 len: 0 microversion: 2.1 time: 0.211322 May 17 15:58:06.944702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 506/1008] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:58:06 2022] DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments/428f6990-0bc2-4af1-9f3b-6d87c9a35866 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:58:06.953610 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:06.955210 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:06.962167 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:06.962624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:06.963401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:06.964001 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:06.994725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-cf1bf0a8-c260-4b35-9128-06d882a0cd13 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045358 May 17 15:58:06.998861 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 503/1009] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:58:06 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:07.476853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-5c777b5f-a37e-40c1-950a-1555cbbf9bf0 req-532a0722-5a56-498e-8b66-53e1546e5bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:07.485714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-5c777b5f-a37e-40c1-950a-1555cbbf9bf0 req-532a0722-5a56-498e-8b66-53e1546e5bb2 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:07.486187 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-5c777b5f-a37e-40c1-950a-1555cbbf9bf0 req-532a0722-5a56-498e-8b66-53e1546e5bb2 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:07.497825 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-5c777b5f-a37e-40c1-950a-1555cbbf9bf0 req-532a0722-5a56-498e-8b66-53e1546e5bb2 service nova] Creating event network-changed:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:58:07.502488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-5c777b5f-a37e-40c1-950a-1555cbbf9bf0 req-532a0722-5a56-498e-8b66-53e1546e5bb2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029622 May 17 15:58:07.503080 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 507/1010] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:08.006242 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:08.007198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:08.013454 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:08.013965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:08.014774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:08.015212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:08.044182 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-65c2987f-e17f-4adb-a2e8-f2643a5bff20 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042067 May 17 15:58:08.044769 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 504/1011] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:58:08 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:58:08.055530 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:08.056117 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:08.062234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:08.062693 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:08.063459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:08.063897 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:08.138319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] HTTP exception thrown: Instance 16da988b-84bf-434d-8672-8e64763bec13 is not attached to volume 428f6990-0bc2-4af1-9f3b-6d87c9a35866 May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Request method failure captured: May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments/428f6990-0bc2-4af1-9f3b-6d87c9a35866 HTTP/1.1 May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8VHQ-CclFa73f1D-RYHu3QEf1HipptIldfa3fYJ-lvD9-VPCRL5oSv542F1IuPQ7U3uIFFriVZtUkfWNaMDt4K22FMuCbHPDgrj6U8NMUKtP-Yt03ykVZjmTVYPlHkvsvX1smfR895PxR16Z8kH4KDMG59hD_BWe6OjuGpHSzKadGQ May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 8636ddd509654ba48dc18dc2837ee0df May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-TestMinimumBasicScenario-1549467178 May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 15:58:08.141006 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8636ddd509654ba48dc18dc2837ee0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8636ddd509654ba48dc18dc2837ee0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8636ddd509654ba48dc18dc2837ee0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8636ddd509654ba48dc18dc2837ee0df"}]}] May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-TestMinimumBasicScenario-1549467178 May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 8636ddd509654ba48dc18dc2837ee0df May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1549467178 May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-TestMinimumBasicScenario-1549467178-project May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 4b5965b27f1b4ca38680e50363765387 May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-TestMinimumBasicScenario-1549467178-project May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 15:58:08.142801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 16da988b-84bf-434d-8672-8e64763bec13 is not attached to volume 428f6990-0bc2-4af1-9f3b-6d87c9a35866 May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'server_id': '16da988b-84bf-434d-8672-8e64763bec13', 'id': '428f6990-0bc2-4af1-9f3b-6d87c9a35866'} May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 428f6990-0bc2-4af1-9f3b-6d87c9a35866. May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:58:08.143700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da988b-84bf-434d-8672-8e64763bec13 is not attached to volume 428f6990-0bc2-4af1-9f3b-6d87c9a35866 May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da988b-84bf-434d-8672-8e64763bec13 is not attached to volume 428f6990-0bc2-4af1-9f3b-6d87c9a35866 May 17 15:58:08.146459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 15:58:08.148878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Returning 404 to user: Instance 16da988b-84bf-434d-8672-8e64763bec13 is not attached to volume 428f6990-0bc2-4af1-9f3b-6d87c9a35866 {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:58:08.149753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0d48da86-456a-42fc-83e9-b502e3f3ed46 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments/428f6990-0bc2-4af1-9f3b-6d87c9a35866" status: 404 len: 154 microversion: 2.1 time: 0.099013 May 17 15:58:08.150353 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 508/1012] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 15:58:08 2022] DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13/os-volume_attachments/428f6990-0bc2-4af1-9f3b-6d87c9a35866 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 15:58:09.282064 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:09.282544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:09.289215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:09.289659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:09.290493 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:09.290924 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:09.314829 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:58:09.385353 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3a980751-d600-46e9-8864-d2d41d7f4cb0 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 204 len: 0 microversion: 2.1 time: 0.106789 May 17 15:58:09.385982 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 505/1013] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:58:09 2022] DELETE /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:58:09.394279 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:09.394933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:09.401283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:09.401738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:09.402537 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:09.402980 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:09.534034 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:09.541831 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c0642635-25c4-4a5e-be75-c60a8a7397fe tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1554 microversion: 2.1 time: 0.151494 May 17 15:58:09.542419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 509/1014] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:09 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:10.183247 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:10.184260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:10.190027 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.190498 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.191260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.191691 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.220079 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ac78973a-951a-43c9-a9dc-dbcc154afeed tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041211 May 17 15:58:10.220623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 506/1015] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:58:10 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 15:58:10.277885 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:10.278412 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:10.284292 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.284729 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.285494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.285925 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.310145 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 15:58:10.383887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6a550844-5a45-44c3-9cfd-3e1cc0d6d69a tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 204 len: 0 microversion: 2.1 time: 0.109495 May 17 15:58:10.384409 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 510/1016] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 15:58:10 2022] DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 15:58:10.392505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:10.393146 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:10.399404 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.399854 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.400609 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.401044 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.559862 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:10.560584 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:10.567714 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.568171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.568949 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:10.569391 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:10.576954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:10.584362 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9034f0de-a9c7-43fc-ab7b-9e2766275d54 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1673 microversion: 2.1 time: 0.195705 May 17 15:58:10.594038 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 507/1017] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:10 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:10.696892 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:10.704138 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9043b667-9659-4dd2-b7ad-bec369976951 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1554 microversion: 2.1 time: 0.148511 May 17 15:58:10.704700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 511/1018] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:10 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:58:11.601293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:11.601890 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:11.608589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:11.609275 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:11.610066 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:11.610508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:11.720667 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:11.721283 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:11.727638 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:11.728090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:11.728863 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:11.729302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:11.743695 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:11.751116 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-93f33d82-7186-46b6-a434-dd31c093388f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1673 microversion: 2.1 time: 0.153634 May 17 15:58:11.751885 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 508/1019] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:11 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:11.861218 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:11.869026 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-2f1f149c-0bd6-49c5-b309-8fc93579bcc4 tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1554 microversion: 2.1 time: 0.152168 May 17 15:58:11.869580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 512/1020] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:11 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:58:12.768607 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:12.769221 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:12.776036 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:12.776486 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:12.777251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:12.777685 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:12.885648 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:12.886291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:12.892791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:12.893242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:12.894036 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:12.894484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:13.061507 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:13.069340 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9951fb35-e2c7-4c61-b2f8-0de312304e72 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1673 microversion: 2.1 time: 0.304562 May 17 15:58:13.069905 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 509/1021] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:12 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1673 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:13.227992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5965b27f1b4ca38680e50363765387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8636ddd509654ba48dc18dc2837ee0df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:13.239645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5ff5801d-923d-4de0-bd52-99574768113d tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 200 len: 1554 microversion: 2.1 time: 0.357217 May 17 15:58:13.240255 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 513/1022] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:12 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 1554 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:58:13.458570 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-6898f47a-4286-45b1-b8f6-c229eda31693 req-dbafe21b-fb55-4bfd-ba1d-892c097be5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16da988b-84bf-434d-8672-8e64763bec13", "name": "network-vif-deleted", "tag": "09580395-7ff8-4876-a686-2b6cb4a99304"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:13.466883 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-6898f47a-4286-45b1-b8f6-c229eda31693 req-dbafe21b-fb55-4bfd-ba1d-892c097be5a2 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:13.467595 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-6898f47a-4286-45b1-b8f6-c229eda31693 req-dbafe21b-fb55-4bfd-ba1d-892c097be5a2 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:13.480149 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-6898f47a-4286-45b1-b8f6-c229eda31693 req-dbafe21b-fb55-4bfd-ba1d-892c097be5a2 service nova] Creating event network-vif-deleted:09580395-7ff8-4876-a686-2b6cb4a99304 for instance 16da988b-84bf-434d-8672-8e64763bec13 on hv-cinder-84212 May 17 15:58:13.485543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-6898f47a-4286-45b1-b8f6-c229eda31693 req-dbafe21b-fb55-4bfd-ba1d-892c097be5a2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 May 17 15:58:13.486187 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 510/1023] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:14.088555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:14.088555 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:14.094654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:14.095426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:14.096459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:14.097157 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:14.173945 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:14.183680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-faccbfa2-b8bd-4b36-9d3e-8307044eaea8 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 200 len: 1605 microversion: 2.1 time: 0.100960 May 17 15:58:14.184576 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 514/1024] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:14 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 1605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:14.258095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:14.258754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] [instance: 16da988b-84bf-434d-8672-8e64763bec13] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:14.265727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:14.266240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:14.267027 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:14.267462 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:14.282642 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] HTTP exception thrown: Instance 16da988b-84bf-434d-8672-8e64763bec13 could not be found. May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Request method failure captured: May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 HTTP/1.1 May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8VHQ-CclFa73f1D-RYHu3QEf1HipptIldfa3fYJ-lvD9-VPCRL5oSv542F1IuPQ7U3uIFFriVZtUkfWNaMDt4K22FMuCbHPDgrj6U8NMUKtP-Yt03ykVZjmTVYPlHkvsvX1smfR895PxR16Z8kH4KDMG59hD_BWe6OjuGpHSzKadGQ May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 8636ddd509654ba48dc18dc2837ee0df May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-TestMinimumBasicScenario-1549467178 May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:58:14.284585 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8636ddd509654ba48dc18dc2837ee0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_8636ddd509654ba48dc18dc2837ee0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/8636ddd509654ba48dc18dc2837ee0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/8636ddd509654ba48dc18dc2837ee0df"}]}] May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-TestMinimumBasicScenario-1549467178 May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 8636ddd509654ba48dc18dc2837ee0df May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1549467178 May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-TestMinimumBasicScenario-1549467178-project May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 4b5965b27f1b4ca38680e50363765387 May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-TestMinimumBasicScenario-1549467178-project May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 16da988b-84bf-434d-8672-8e64763bec13 could not be found. May 17 15:58:14.286785 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '16da988b-84bf-434d-8672-8e64763bec13'} May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16da988b-84bf-434d-8672-8e64763bec13 could not be found. May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:58:14.287580 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16da988b-84bf-434d-8672-8e64763bec13 could not be found. May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16da988b-84bf-434d-8672-8e64763bec13 could not be found. May 17 15:58:14.289010 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:14.290566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Returning 404 to user: Instance 16da988b-84bf-434d-8672-8e64763bec13 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:58:14.290566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e40a6b15-1f90-4ccc-b2dd-eeadad244eca tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13" status: 404 len: 111 microversion: 2.1 time: 0.033429 May 17 15:58:14.290566 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 511/1025] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:14 2022] GET /compute/v2.1/servers/16da988b-84bf-434d-8672-8e64763bec13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:58:14.295426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8f62e4ee-dd44-426b-abb7-7fa61b14753e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] Calling method '.version_select at 0x7f84005aa040>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:14.316198 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8f62e4ee-dd44-426b-abb7-7fa61b14753e tempest-TestMinimumBasicScenario-1549467178 tempest-TestMinimumBasicScenario-1549467178-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1918482597" status: 202 len: 0 microversion: 2.1 time: 0.024537 May 17 15:58:14.317169 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 515/1026] 10.222.0.75 () {58 vars in 1271 bytes} [Tue May 17 15:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1918482597 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:58:15.202367 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:15.203007 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:15.209520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:15.209974 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:15.210775 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:15.211219 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:15.224495 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] HTTP exception thrown: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Request method failure captured: May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 HTTP/1.1 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8Ttqr8Ig_8oAlYvv0XjHJyA-37-F7LIEoNP7itKDGsNGiOCyaYFBH9-E7LrdVx2Gs4_yH_BzxFIIfCYrvO-kzXGe0DTCRdJQZdn0hdiXSUfuu2wT3QSI8-1wK-31bzTMrZ6lSSlNcplPTGjG3giz_WKDwTjH6ZHkvMqCzZHZrX5P44 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: fabeead7b416455b8d93f9531f895ba4 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeTestJSON-372899460 May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 15:58:15.226033 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fabeead7b416455b8d93f9531f895ba4"}]}] May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeTestJSON-372899460 May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: fabeead7b416455b8d93f9531f895ba4 May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-372899460 May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeTestJSON-372899460-project May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 5a87409628484aa189c7dd44ee74344d May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeTestJSON-372899460-project May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 15:58:15.227455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'e015bc8e-5811-406b-9e5c-76dff4966153'} May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 15:58:15.228279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 15:58:15.229978 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 15:58:15.231429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Returning 404 to user: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 15:58:15.231429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5bb6e8f0-7deb-4471-acb7-5c15cf36d497 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 404 len: 111 microversion: 2.1 time: 0.029173 May 17 15:58:15.231429 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 512/1027] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:15 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 15:58:15.237392 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4ba627f6-614a-4f20-a6fc-f5a93d1e1411 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '.version_select at 0x7f84005da940>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:15.255618 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4ba627f6-614a-4f20-a6fc-f5a93d1e1411 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-342100155" status: 202 len: 0 microversion: 2.1 time: 0.022492 May 17 15:58:15.256289 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 516/1028] 10.222.0.75 () {58 vars in 1217 bytes} [Tue May 17 15:58:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-342100155 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 15:58:15.501328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a60f5bb9-6922-4ca7-991f-7d3eb6cc2f3b req-1f514e38-e547-4521-85a4-2fd54a2d0b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e015bc8e-5811-406b-9e5c-76dff4966153", "name": "network-vif-deleted", "tag": "e9a46791-512d-4556-80f5-15349d3449b9"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:15.509546 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a60f5bb9-6922-4ca7-991f-7d3eb6cc2f3b req-1f514e38-e547-4521-85a4-2fd54a2d0b28 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:15.510215 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a60f5bb9-6922-4ca7-991f-7d3eb6cc2f3b req-1f514e38-e547-4521-85a4-2fd54a2d0b28 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:15.523456 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a60f5bb9-6922-4ca7-991f-7d3eb6cc2f3b req-1f514e38-e547-4521-85a4-2fd54a2d0b28 service nova] Creating event network-vif-deleted:e9a46791-512d-4556-80f5-15349d3449b9 for instance e015bc8e-5811-406b-9e5c-76dff4966153 on hv-cinder-84212 May 17 15:58:15.528233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-a60f5bb9-6922-4ca7-991f-7d3eb6cc2f3b req-1f514e38-e547-4521-85a4-2fd54a2d0b28 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 May 17 15:58:15.529043 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 513/1029] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:15.997343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-68d38d56-810c-4565-88a8-a284614a832f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: .version_select at 0x7f84005da040>, body: {"keypair": {"name": "tempest-keypair-378084807", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFuY2x7czS9pzIcbi1Fdymvf+rtMbPr0FMlezlw5RQZQIA5GR3MQyxoUf27ba6xwXcHqpTtBYGXppM54ivC2h4IxEr/LaF03wsl+u8hYDdb72wngfyM9NJ7+IkGOWeimQ=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:16.011638 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-68d38d56-810c-4565-88a8-a284614a832f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for project fabeead7b416455b8d93f9531f895ba4. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:58:16.015645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-68d38d56-810c-4565-88a8-a284614a832f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for user 5a87409628484aa189c7dd44ee74344d and project fabeead7b416455b8d93f9531f895ba4. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:58:16.039520 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-68d38d56-810c-4565-88a8-a284614a832f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046050 May 17 15:58:16.042204 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 517/1030] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:58:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:18.127903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1288530029", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "917a09a1-2bd7-4381-9dcc-06a916729d23"}], "security_groups": [{"name": "tempest-securitygroup--1497748202"}], "key_name": "tempest-keypair-378084807", "user_data": "}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:18.252162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] validate_networks() for [('917a09a1-2bd7-4381-9dcc-06a916729d23', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:58:18.762154 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:58:18.762581 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:58:18.763053 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:58:18.763460 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:58:18.763874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:58:18.772432 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:18.772875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:18.773668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:18.774199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:18.790173 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for project fabeead7b416455b8d93f9531f895ba4. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:58:18.794632 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Getting quotas for user 5a87409628484aa189c7dd44ee74344d and project fabeead7b416455b8d93f9531f895ba4. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:58:18.806289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:58:18.808650 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:58:18.854757 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ed3b60f3-4bf4-4a5c-9b25-d783af7aeec3 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.821178 May 17 15:58:18.856032 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 514/1031] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:58:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:58:18.884113 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8c04f63d-0e78-478c-8d56-c6e2ac7b0909 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:18.884745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8c04f63d-0e78-478c-8d56-c6e2ac7b0909 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:18.951120 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8c04f63d-0e78-478c-8d56-c6e2ac7b0909 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:18.958972 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8c04f63d-0e78-478c-8d56-c6e2ac7b0909 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1237 microversion: 2.1 time: 0.097138 May 17 15:58:18.959668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 518/1032] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:18 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 15:58:19.977061 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:19.977763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:19.984268 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:19.984807 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:19.985640 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:19.986205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:20.087162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:20.094544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-77a24547-a01e-47a1-852a-877e5b1dc095 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1295 microversion: 2.1 time: 0.122424 May 17 15:58:20.095208 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 515/1033] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:19 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1295 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:21.112027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:21.112647 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:21.127715 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:21.128471 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:21.129986 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:21.130615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:21.411900 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:21.422667 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-722eb018-c97f-432e-ae5d-b787f770d7db tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.314328 May 17 15:58:21.433235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 519/1034] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:21 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:21.835125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-5d826525-60d7-4493-b53b-45953e2e6fcd req-394ad616-1579-4dac-883c-3dc0eb6b673b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b274fc-bee9-4e2c-bd97-8f7b11363c74", "tag": "3e7a2775-32cc-4d52-84e3-1fb8e668f043"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:21.848151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-5d826525-60d7-4493-b53b-45953e2e6fcd req-394ad616-1579-4dac-883c-3dc0eb6b673b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:21.848744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-5d826525-60d7-4493-b53b-45953e2e6fcd req-394ad616-1579-4dac-883c-3dc0eb6b673b service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:21.874475 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-5d826525-60d7-4493-b53b-45953e2e6fcd req-394ad616-1579-4dac-883c-3dc0eb6b673b service nova] Creating event network-changed:3e7a2775-32cc-4d52-84e3-1fb8e668f043 for instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 on hv-cinder-84212 May 17 15:58:21.880842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-5d826525-60d7-4493-b53b-45953e2e6fcd req-394ad616-1579-4dac-883c-3dc0eb6b673b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049248 May 17 15:58:21.888723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 516/1035] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:22.439958 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:22.440583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:22.447633 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:22.448092 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:22.448865 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:22.449313 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:22.590323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:22.597589 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-61de1e7c-a7d7-4161-af42-448d0a1ca352 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.161508 May 17 15:58:22.598222 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 520/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:22 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:23.615421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:23.616154 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:23.622331 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:23.622790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:23.623563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:23.624110 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:23.823515 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:23.831011 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-08ad4184-c31b-41c6-9175-ebcba6fa1e94 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.220446 May 17 15:58:23.831582 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 517/1037] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:23 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:24.850625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:24.851212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:24.861066 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:24.861740 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:24.862893 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:24.864040 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:25.049155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:25.071691 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ae4d4a25-9705-48da-93a7-12780c3fd9d1 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.225965 May 17 15:58:25.072986 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 521/1038] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:24 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:26.089234 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:26.089851 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:26.101953 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:26.104602 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:26.106494 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:26.106958 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:26.287235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:26.295191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-241f95d1-3441-4770-be33-90306654f4a9 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.209840 May 17 15:58:26.295771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 518/1039] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:26 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:27.312947 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:27.314422 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:27.323970 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:27.327002 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:27.327860 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:27.328304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:27.545503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:27.556416 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-92615bb3-a57b-4b36-8409-ae1686cd01e4 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.245831 May 17 15:58:27.557763 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 522/1040] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:27 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:27.608220 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-35058bf3-6bd2-48f1-b10e-6388963c71ab req-bbf76db9-9d7c-4f08-9881-88ca2ffec4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b274fc-bee9-4e2c-bd97-8f7b11363c74", "name": "network-vif-plugged", "status": "completed", "tag": "3e7a2775-32cc-4d52-84e3-1fb8e668f043"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:27.621696 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-35058bf3-6bd2-48f1-b10e-6388963c71ab req-bbf76db9-9d7c-4f08-9881-88ca2ffec4b4 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:27.622371 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-35058bf3-6bd2-48f1-b10e-6388963c71ab req-bbf76db9-9d7c-4f08-9881-88ca2ffec4b4 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:27.643068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-35058bf3-6bd2-48f1-b10e-6388963c71ab req-bbf76db9-9d7c-4f08-9881-88ca2ffec4b4 service nova] Creating event network-vif-plugged:3e7a2775-32cc-4d52-84e3-1fb8e668f043 for instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 on hv-cinder-84212 May 17 15:58:27.649433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-35058bf3-6bd2-48f1-b10e-6388963c71ab req-bbf76db9-9d7c-4f08-9881-88ca2ffec4b4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048386 May 17 15:58:27.651126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 519/1041] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:28.576359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:28.576985 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:28.584861 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:28.585323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:28.586140 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:28.586583 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:28.768745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:28.798347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1ceb6367-1b35-4b85-a45f-502ea1020883 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1363 microversion: 2.1 time: 0.228330 May 17 15:58:28.803931 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 523/1042] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:28 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:29.820730 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:29.821425 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:29.828003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:29.828448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:29.829223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:29.829654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:29.974703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:29.982520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9475ca3a-05cc-4dcb-a858-3e2fe3d4f15f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1549 microversion: 2.1 time: 0.165827 May 17 15:58:29.982986 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 520/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:29 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:58:29.998753 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:30.003718 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:30.006079 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:30.006544 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:30.007323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:30.007762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:30.094463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e0132128-ec83-478a-9f0a-2ad734abc90f tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099427 May 17 15:58:30.095335 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 524/1044] 10.222.0.75 () {58 vars in 1274 bytes} [Tue May 17 15:58:29 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:32.692175 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-29144332-a289-4f5a-9087-d6131f298eee req-68c6e97d-3661-464a-bf1c-5a8462c60262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b274fc-bee9-4e2c-bd97-8f7b11363c74", "tag": "3e7a2775-32cc-4d52-84e3-1fb8e668f043"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:32.709004 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-29144332-a289-4f5a-9087-d6131f298eee req-68c6e97d-3661-464a-bf1c-5a8462c60262 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:32.709790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-29144332-a289-4f5a-9087-d6131f298eee req-68c6e97d-3661-464a-bf1c-5a8462c60262 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:32.727554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-29144332-a289-4f5a-9087-d6131f298eee req-68c6e97d-3661-464a-bf1c-5a8462c60262 service nova] Creating event network-changed:3e7a2775-32cc-4d52-84e3-1fb8e668f043 for instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 on hv-cinder-84212 May 17 15:58:32.743105 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-29144332-a289-4f5a-9087-d6131f298eee req-68c6e97d-3661-464a-bf1c-5a8462c60262 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391797 May 17 15:58:32.744491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 521/1045] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:58:34.159326 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b904b420-8af7-4177-bde7-8af49f350ea6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Action: 'create', calling method: .version_select at 0x7f8400615670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-327864240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6t3HKfpnMb93AAlTPGuYKGJ7X7ILRZJPG0590agblfv/JYwiEU7slO+N7u1UqdWs6Vl7XWkZZIc84jeVfW3zdPum/wBanAGb3s3Mfq5j8ESJdsm92zPq8yuDHFswdoBw=="}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:34.173091 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-b904b420-8af7-4177-bde7-8af49f350ea6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for project fbe368679f4c4d968619ea0e2456c407. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:58:34.177282 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-b904b420-8af7-4177-bde7-8af49f350ea6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for user 3df48c5aad0f4cb5aeb7c76d82ab0b4b and project fbe368679f4c4d968619ea0e2456c407. Resources: {'key_pairs'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:58:34.200882 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b904b420-8af7-4177-bde7-8af49f350ea6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.141230 May 17 15:58:34.201489 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 525/1046] 10.222.0.75 () {60 vars in 1158 bytes} [Tue May 17 15:58:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:58:42.635052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 15:58:42.635659 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 15:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 15:58:51.727906 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 15:58:51.728507 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 15:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 15:58:58.697150 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-95005571", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327864240", "security_groups": [{"name": "tempest-secgroup-smoke-252411881"}], "block_device_mapping_v2": [{"uuid": "cdb1339b-0f24-4703-acb1-99a6e0a8e1e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f4eb954-5185-441c-9dd5-cd8454980b48"}]}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:58:58.804704 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] validate_networks() for [('6f4eb954-5185-441c-9dd5-cd8454980b48', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 15:58:59.158357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 15:58:59.158781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 15:58:59.159255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 15:58:59.159662 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 15:58:59.160067 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 15:58:59.168608 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:59.169052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:59.169850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:58:59.170321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:58:59.186311 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for project fbe368679f4c4d968619ea0e2456c407. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 15:58:59.190513 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for user 3df48c5aad0f4cb5aeb7c76d82ab0b4b and project fbe368679f4c4d968619ea0e2456c407. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 15:58:59.246556 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 15:58:59.248746 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdb1339b-0f24-4703-acb1-99a6e0a8e1e9',volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 15:58:59.370178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5dcc4e01-53fd-4108-a7d3-8291b9ea2323 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.676688 May 17 15:58:59.370810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 522/1047] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 15:58:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 15:58:59.380690 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ab73049b-9f13-4945-93c8-2f690cf706e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:58:59.381315 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ab73049b-9f13-4945-93c8-2f690cf706e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:58:59.439431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ab73049b-9f13-4945-93c8-2f690cf706e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:58:59.446082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ab73049b-9f13-4945-93c8-2f690cf706e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1092 microversion: 2.1 time: 0.069249 May 17 15:58:59.455676 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 526/1048] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:58:59 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1092 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:00.462900 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:00.464051 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:00.470501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:00.470955 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:00.471737 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:00.472178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:00.552787 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:00.560564 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-205ccff1-f116-4b7c-a399-975597b42a52 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1208 microversion: 2.1 time: 0.101974 May 17 15:59:00.561191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 523/1049] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:00 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1208 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:01.578397 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:01.579908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:01.587342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:01.587774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:01.588565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:01.588999 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:01.604581 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-a1e4c99b-b26a-487c-b0a7-2a9a2370c8c1 req-e3c8be79-ca69-41a0-b6f9-da85cda0b495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453bba5c-49db-439a-8ff8-095ff05a6d3f", "tag": "05eade37-4ca5-4a52-8b62-e077ce332ef1"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:59:01.628554 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a1e4c99b-b26a-487c-b0a7-2a9a2370c8c1 req-e3c8be79-ca69-41a0-b6f9-da85cda0b495 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:01.630555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-a1e4c99b-b26a-487c-b0a7-2a9a2370c8c1 req-e3c8be79-ca69-41a0-b6f9-da85cda0b495 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:01.653171 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-a1e4c99b-b26a-487c-b0a7-2a9a2370c8c1 req-e3c8be79-ca69-41a0-b6f9-da85cda0b495 service nova] Creating event network-changed:05eade37-4ca5-4a52-8b62-e077ce332ef1 for instance 453bba5c-49db-439a-8ff8-095ff05a6d3f on hv-cinder-84212 May 17 15:59:01.659092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-a1e4c99b-b26a-487c-b0a7-2a9a2370c8c1 req-e3c8be79-ca69-41a0-b6f9-da85cda0b495 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061502 May 17 15:59:01.660225 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 524/1050] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:59:01.834431 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:01.842082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-315e23ca-4562-4ffe-be2d-daa68924c38b tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.267526 May 17 15:59:01.842743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 527/1051] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:01 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:02.859960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:02.860656 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:02.867189 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:02.867636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:02.868394 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:02.868827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:03.044412 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:03.052201 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-de1007ed-e6e1-46f4-9971-f93d7bdfd752 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.196647 May 17 15:59:03.052964 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 525/1052] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:02 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:04.068684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:04.069303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:04.076256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:04.076708 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:04.077505 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:04.077938 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:04.207237 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:04.214525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-bedd844f-7888-4b53-ba2b-a242fe6724f6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.149692 May 17 15:59:04.215090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 528/1053] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:04 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:05.230491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:05.231356 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:05.237548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:05.237989 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:05.238772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:05.239199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:05.364511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:05.371777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d659ad8e-50af-4ea2-88d8-630d1c46ff99 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.145161 May 17 15:59:05.372328 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 526/1054] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:05 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:06.388772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:06.389386 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:06.395924 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:06.396376 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:06.397143 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:06.397579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:06.523474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:06.530933 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8529665c-2112-4072-8c9c-6483982b0072 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.146361 May 17 15:59:06.531506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 529/1055] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:06 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:07.547875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:07.548492 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:07.554834 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:07.555272 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:07.556039 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:07.556467 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:07.688827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:07.696120 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d321b5c5-4aba-4290-be55-f32e3190a692 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.152454 May 17 15:59:07.696684 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 527/1056] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:07 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:08.712609 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:08.713826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:08.720781 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:08.721234 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:08.722021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:08.722506 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:08.851758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:08.859813 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1b5c431b-63df-4769-87ea-846e648102bf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.151088 May 17 15:59:08.860382 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 530/1057] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:08 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:09.877615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:09.878261 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:09.885239 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:09.885700 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:09.886540 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:09.886980 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:10.333833 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:10.341934 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-0abf7829-2556-4d4a-99f8-02a98c675e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.469236 May 17 15:59:10.342560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 528/1058] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:09 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:11.358902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:11.359520 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:11.365888 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:11.366379 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:11.367152 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:11.367598 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:11.495611 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:11.503293 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ccaa85f8-dc93-45e2-bf3a-75dae44f9872 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.148467 May 17 15:59:11.503864 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 531/1059] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:11 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:12.519670 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:12.520283 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:12.526657 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:12.527106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:12.527869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:12.528303 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:12.658257 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:12.665444 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7a56c63d-5f2b-4375-b3f9-d6431994326a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.149582 May 17 15:59:12.666559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 529/1060] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:12 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:13.667551 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-ca7efe6a-d4ad-4887-948f-76f2beae9b2e req-88e7031c-2d06-4b40-b497-bc5ee2799628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453bba5c-49db-439a-8ff8-095ff05a6d3f", "name": "network-vif-plugged", "status": "completed", "tag": "05eade37-4ca5-4a52-8b62-e077ce332ef1"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:59:13.676357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ca7efe6a-d4ad-4887-948f-76f2beae9b2e req-88e7031c-2d06-4b40-b497-bc5ee2799628 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:13.677124 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-ca7efe6a-d4ad-4887-948f-76f2beae9b2e req-88e7031c-2d06-4b40-b497-bc5ee2799628 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:13.683841 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:13.684927 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:13.690617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-ca7efe6a-d4ad-4887-948f-76f2beae9b2e req-88e7031c-2d06-4b40-b497-bc5ee2799628 service nova] Creating event network-vif-plugged:05eade37-4ca5-4a52-8b62-e077ce332ef1 for instance 453bba5c-49db-439a-8ff8-095ff05a6d3f on hv-cinder-84212 May 17 15:59:13.691558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:13.692015 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:13.692825 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:13.693266 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:13.695802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-ca7efe6a-d4ad-4887-948f-76f2beae9b2e req-88e7031c-2d06-4b40-b497-bc5ee2799628 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032165 May 17 15:59:13.696769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 532/1061] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:59:13.832378 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:13.840875 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-ef1d3bc9-f5fc-42f4-afbb-3d55347eb052 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.162541 May 17 15:59:13.841673 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 530/1062] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:13 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:14.859788 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:14.860487 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:14.866660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:14.867116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:14.867887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:14.868331 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:14.996519 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:15.003835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e31e18f1-0a9b-4943-b1d4-702e2e9376ff tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1263 microversion: 2.1 time: 0.149025 May 17 15:59:15.004414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 533/1063] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:14 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:16.020831 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:16.021444 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:16.027798 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:16.028252 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:16.029028 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:16.029470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:16.312118 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:16.319394 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b64555ce-98dd-4a9c-a188-4f1a0366756a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1449 microversion: 2.1 time: 0.302379 May 17 15:59:16.319957 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 531/1064] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:16 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1449 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:16.335122 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:16.335745 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:16.342057 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:16.342524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:16.343303 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:16.343748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:16.474528 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 15:59:16.484250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f4004a16-f00c-4055-a368-bdf8c2ea0b5e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1449 microversion: 2.1 time: 0.152872 May 17 15:59:16.484839 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 534/1065] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 15:59:16 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 15:59:18.328142 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-87d26cd4-167f-4ef6-bcd0-a52047250c11 req-3be3111e-9894-40f4-9637-c00094143dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "453bba5c-49db-439a-8ff8-095ff05a6d3f", "tag": "05eade37-4ca5-4a52-8b62-e077ce332ef1"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:59:18.336637 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-87d26cd4-167f-4ef6-bcd0-a52047250c11 req-3be3111e-9894-40f4-9637-c00094143dcd service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:18.337085 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-87d26cd4-167f-4ef6-bcd0-a52047250c11 req-3be3111e-9894-40f4-9637-c00094143dcd service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:18.348373 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-87d26cd4-167f-4ef6-bcd0-a52047250c11 req-3be3111e-9894-40f4-9637-c00094143dcd service nova] Creating event network-changed:05eade37-4ca5-4a52-8b62-e077ce332ef1 for instance 453bba5c-49db-439a-8ff8-095ff05a6d3f on hv-cinder-84212 May 17 15:59:18.353946 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-87d26cd4-167f-4ef6-bcd0-a52047250c11 req-3be3111e-9894-40f4-9637-c00094143dcd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028829 May 17 15:59:18.354737 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 532/1066] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 15:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 15:59:47.525666 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:47.526284 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:47.532334 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:47.532792 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:47.533569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:47.534029 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:47.556692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e5a56eef-848c-4523-85a5-003861f773ac tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/ips" status: 200 len: 146 microversion: 2.1 time: 0.034492 May 17 15:59:47.557249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 535/1067] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 15:59:47 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:59:48.861534 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57f0a9ff-ae46-4020-bd6e-fcee5d895ba8"}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:59:48.862696 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:48.869030 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:48.869485 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:48.870321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:48.870763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:49.094321 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-bd3e406d-acb8-46d1-a510-adbf5b33208c tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.236912 May 17 15:59:49.094904 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 533/1068] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:59:48 2022] POST /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments => generated 194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:59:56.567021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:56.567980 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:56.574875 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:56.575321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:56.576083 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:56.576517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:56.606053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f33bff5b-660b-4176-a7fa-5f0d5d2cdf00 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 May 17 15:59:56.606843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 536/1069] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 15:59:56 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:59:56.617490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 15:59:56.618683 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:56.624868 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:56.625322 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:56.632648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:56.632648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:56.655042 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8393ec31-745c-4a8d-a7cb-536c075e0d27 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/57f0a9ff-ae46-4020-bd6e-fcee5d895ba8" status: 200 len: 194 microversion: 2.1 time: 0.042197 May 17 15:59:56.655610 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 534/1070] 10.222.0.75 () {58 vars in 1412 bytes} [Tue May 17 15:59:56 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/57f0a9ff-ae46-4020-bd6e-fcee5d895ba8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 15:59:57.958494 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430052a6-f9a8-4d30-89f0-d40b94325d2a"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 15:59:57.959588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 15:59:57.966444 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:57.966897 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:57.967684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 15:59:57.968111 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 15:59:58.196878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b917e64d-5004-4b9a-9932-bdffba52d82d tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "POST /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241707 May 17 15:59:58.197525 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 537/1071] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 15:59:57 2022] POST /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:00:05.663292 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:05.664245 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:05.670630 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:05.671087 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:05.671853 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:05.672293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:05.701008 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c64194b2-18c8-40b5-8278-61b666c7aaa7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041806 May 17 16:00:05.701545 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 535/1072] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 16:00:05 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:00:05.840156 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:05.840678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:05.846764 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:05.847212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:05.847987 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:05.848412 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:05.877422 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a127623d-b128-410a-92a2-ac7e210ca523 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/57f0a9ff-ae46-4020-bd6e-fcee5d895ba8" status: 200 len: 194 microversion: 2.1 time: 0.042308 May 17 16:00:05.878017 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 538/1073] 10.222.0.75 () {58 vars in 1412 bytes} [Tue May 17 16:00:05 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/57f0a9ff-ae46-4020-bd6e-fcee5d895ba8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:00:05.887401 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:05.887899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:05.893811 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:05.894293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:05.895059 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:05.895499 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:05.978876 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lazy-loading 'services' on Instance uuid f1b274fc-bee9-4e2c-bd97-8f7b11363c74 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:00:06.049132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8bd2454a-ab96-4bed-9c5e-4585ce44a574 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/57f0a9ff-ae46-4020-bd6e-fcee5d895ba8" status: 202 len: 0 microversion: 2.1 time: 0.165471 May 17 16:00:06.049721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 536/1074] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 16:00:05 2022] DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/57f0a9ff-ae46-4020-bd6e-fcee5d895ba8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 16:00:07.172180 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:07.172702 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:07.178969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:07.179423 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:07.180202 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:07.180644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:07.210292 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-48fe06a2-d9eb-4401-86b5-1546d84deb84 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/430052a6-f9a8-4d30-89f0-d40b94325d2a" status: 200 len: 194 microversion: 2.1 time: 0.042082 May 17 16:00:07.210870 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 539/1075] 10.222.0.75 () {58 vars in 1412 bytes} [Tue May 17 16:00:07 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/430052a6-f9a8-4d30-89f0-d40b94325d2a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:00:07.222105 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:07.222722 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:07.228865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:07.229319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:07.230116 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:07.230561 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:07.307108 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lazy-loading 'services' on Instance uuid f1b274fc-bee9-4e2c-bd97-8f7b11363c74 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:00:07.375164 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e359cb12-348d-465e-9f62-eeaf1d4ad3da tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/430052a6-f9a8-4d30-89f0-d40b94325d2a" status: 202 len: 0 microversion: 2.1 time: 0.157675 May 17 16:00:07.376003 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 537/1076] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 16:00:07 2022] DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments/430052a6-f9a8-4d30-89f0-d40b94325d2a => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 16:00:08.540935 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:08.541868 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:08.548287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.548749 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.549526 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.549971 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.578302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d72505c4-83ef-4c8a-9fa9-4902dc13e4fe tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041839 May 17 16:00:08.578852 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 540/1077] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 16:00:08 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 16:00:08.679674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:08.680776 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:08.687353 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.687753 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.688524 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.688966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.717293 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9afaa6ae-113b-42f4-a1e9-397ca80144f2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041889 May 17 16:00:08.717826 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 538/1078] 10.222.0.75 () {58 vars in 1301 bytes} [Tue May 17 16:00:08 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 16:00:08.773260 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:08.773783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:08.780169 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.780615 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.781374 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.781809 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.808171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 16:00:08.886720 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e9b6386b-25d7-490d-88d5-a01f0a2643c2 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 204 len: 0 microversion: 2.1 time: 0.116699 May 17 16:00:08.887441 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 541/1079] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:00:08 2022] DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 16:00:08.895674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:08.896290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:08.902302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.902754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:08.903520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:08.903959 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:09.030543 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:00:09.037864 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-fba8c2c7-81a0-470f-9160-5e54605e2225 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1674 microversion: 2.1 time: 0.146042 May 17 16:00:09.038460 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 539/1080] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:08 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:00:10.056926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:10.057625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:10.064004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:10.064454 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:10.065235 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:10.065675 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:10.196715 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:00:10.204027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7879bb3a-ec55-4448-a5d8-4532d4fe67b7 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1674 microversion: 2.1 time: 0.151870 May 17 16:00:10.204602 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 542/1081] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:10 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:00:11.221558 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:11.222132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:11.228519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:11.228971 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:11.229788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:11.230260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:11.470637 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a87409628484aa189c7dd44ee74344d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fabeead7b416455b8d93f9531f895ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:00:11.478602 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-77a05282-5e9c-4717-8c4f-92ba0789b16b tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 200 len: 1674 microversion: 2.1 time: 0.261032 May 17 16:00:11.479418 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 540/1082] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:11 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 1674 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:00:11.938307 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-240e524c-de9a-474b-9c27-b497b9d02a2d req-bb35adf2-1c6b-42b9-bce9-23bea796c7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b274fc-bee9-4e2c-bd97-8f7b11363c74", "name": "network-vif-deleted", "tag": "3e7a2775-32cc-4d52-84e3-1fb8e668f043"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:00:11.947579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-240e524c-de9a-474b-9c27-b497b9d02a2d req-bb35adf2-1c6b-42b9-bce9-23bea796c7ce service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:11.948022 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-240e524c-de9a-474b-9c27-b497b9d02a2d req-bb35adf2-1c6b-42b9-bce9-23bea796c7ce service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:11.959582 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-240e524c-de9a-474b-9c27-b497b9d02a2d req-bb35adf2-1c6b-42b9-bce9-23bea796c7ce service nova] Creating event network-vif-deleted:3e7a2775-32cc-4d52-84e3-1fb8e668f043 for instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 on hv-cinder-84212 May 17 16:00:11.965128 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-240e524c-de9a-474b-9c27-b497b9d02a2d req-bb35adf2-1c6b-42b9-bce9-23bea796c7ce service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030799 May 17 16:00:11.965768 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 543/1083] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:00:12.496896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:12.497519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:12.503917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:12.504365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:12.505135 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:12.505762 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:12.518888 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] HTTP exception thrown: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Request method failure captured: May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 HTTP/1.1 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8Ttqr8Ig_8oAlYvv0XjHJyA-37-F7LIEoNP7itKDGsNGiOCyaYFBH9-E7LrdVx2Gs4_yH_BzxFIIfCYrvO-kzXGe0DTCRdJQZdn0hdiXSUfuu2wT3QSI8-1wK-31bzTMrZ6lSSlNcplPTGjG3giz_WKDwTjH6ZHkvMqCzZHZrX5P44 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:00:12.520573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fabeead7b416455b8d93f9531f895ba4"}]}] May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 5a87409628484aa189c7dd44ee74344d May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:12.522163 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'f1b274fc-bee9-4e2c-bd97-8f7b11363c74'} May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:12.523077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:12.525393 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:12.527082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Returning 404 to user: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:12.527082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-43b47693-ae43-4d6e-b6b1-4a3430bd4dbf tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 404 len: 111 microversion: 2.1 time: 0.029630 May 17 16:00:12.527082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 541/1084] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:12 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:00:12.531567 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7389e31b-a132-4649-a333-b5d5bd63cd90 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '.version_select at 0x7f84006150d0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:12.551486 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7389e31b-a132-4649-a333-b5d5bd63cd90 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-378084807" status: 202 len: 0 microversion: 2.1 time: 0.024193 May 17 16:00:12.552350 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 544/1085] 10.222.0.75 () {58 vars in 1217 bytes} [Tue May 17 16:00:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-378084807 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 16:00:15.404430 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:15.404965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:15.411271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:15.411724 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:15.412491 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:15.412929 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:15.425869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] HTTP exception thrown: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Request method failure captured: May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 HTTP/1.1 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8Ttqr8Ig_8oAlYvv0XjHJyA-37-F7LIEoNP7itKDGsNGiOCyaYFBH9-E7LrdVx2Gs4_yH_BzxFIIfCYrvO-kzXGe0DTCRdJQZdn0hdiXSUfuu2wT3QSI8-1wK-31bzTMrZ6lSSlNcplPTGjG3giz_WKDwTjH6ZHkvMqCzZHZrX5P44 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:00:15.427420 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fabeead7b416455b8d93f9531f895ba4"}]}] May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 5a87409628484aa189c7dd44ee74344d May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.428970 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'f1b274fc-bee9-4e2c-bd97-8f7b11363c74'} May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:15.429800 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.431419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:15.433024 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Returning 404 to user: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:15.433024 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a4603f71-6d10-4c78-9305-6879b3369c76 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 404 len: 111 microversion: 2.1 time: 0.028166 May 17 16:00:15.433024 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 542/1086] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:00:15 2022] DELETE /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:00:15.437188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:15.437929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: f1b274fc-bee9-4e2c-bd97-8f7b11363c74] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:15.444428 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:15.444878 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:15.446213 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:15.446662 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:15.459772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] HTTP exception thrown: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Request method failure captured: May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 HTTP/1.1 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8Ttqr8Ig_8oAlYvv0XjHJyA-37-F7LIEoNP7itKDGsNGiOCyaYFBH9-E7LrdVx2Gs4_yH_BzxFIIfCYrvO-kzXGe0DTCRdJQZdn0hdiXSUfuu2wT3QSI8-1wK-31bzTMrZ6lSSlNcplPTGjG3giz_WKDwTjH6ZHkvMqCzZHZrX5P44 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:00:15.462088 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fabeead7b416455b8d93f9531f895ba4"}]}] May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 5a87409628484aa189c7dd44ee74344d May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.463710 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': 'f1b274fc-bee9-4e2c-bd97-8f7b11363c74'} May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:15.464646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. May 17 16:00:15.466269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:15.467818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Returning 404 to user: Instance f1b274fc-bee9-4e2c-bd97-8f7b11363c74 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:15.467818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c6fd4628-0d8e-4c63-8552-cd554120efc6 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74" status: 404 len: 111 microversion: 2.1 time: 0.030195 May 17 16:00:15.467818 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 545/1087] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:15 2022] GET /compute/v2.1/servers/f1b274fc-bee9-4e2c-bd97-8f7b11363c74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:00:16.595306 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:16.595798 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:16.602136 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:16.602591 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:16.603369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:16.603810 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:16.617068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] HTTP exception thrown: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Request method failure captured: May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 HTTP/1.1 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8Ttqr8Ig_8oAlYvv0XjHJyA-37-F7LIEoNP7itKDGsNGiOCyaYFBH9-E7LrdVx2Gs4_yH_BzxFIIfCYrvO-kzXGe0DTCRdJQZdn0hdiXSUfuu2wT3QSI8-1wK-31bzTMrZ6lSSlNcplPTGjG3giz_WKDwTjH6ZHkvMqCzZHZrX5P44 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:00:16.619111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fabeead7b416455b8d93f9531f895ba4"}]}] May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 5a87409628484aa189c7dd44ee74344d May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.620754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'e015bc8e-5811-406b-9e5c-76dff4966153'} May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:16.621589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.622899 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:16.624198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Returning 404 to user: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:16.624198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4fe8ec94-b38a-4192-8eae-8024c8625157 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 404 len: 111 microversion: 2.1 time: 0.029205 May 17 16:00:16.624198 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 543/1088] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:00:16 2022] DELETE /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:00:16.628928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:16.629549 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] [instance: e015bc8e-5811-406b-9e5c-76dff4966153] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:16.636477 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:16.636928 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:16.637705 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:16.638185 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:16.651342 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] HTTP exception thrown: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Request method failure captured: May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 HTTP/1.1 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8Ttqr8Ig_8oAlYvv0XjHJyA-37-F7LIEoNP7itKDGsNGiOCyaYFBH9-E7LrdVx2Gs4_yH_BzxFIIfCYrvO-kzXGe0DTCRdJQZdn0hdiXSUfuu2wT3QSI8-1wK-31bzTMrZ6lSSlNcplPTGjG3giz_WKDwTjH6ZHkvMqCzZHZrX5P44 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:00:16.652846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fabeead7b416455b8d93f9531f895ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fabeead7b416455b8d93f9531f895ba4"}]}] May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: fabeead7b416455b8d93f9531f895ba4 May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-AttachVolumeTestJSON-372899460 May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 5a87409628484aa189c7dd44ee74344d May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-AttachVolumeTestJSON-372899460-project May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.654438 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': 'e015bc8e-5811-406b-9e5c-76dff4966153'} May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:16.655478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. May 17 16:00:16.656998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:16.658351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] Returning 404 to user: Instance e015bc8e-5811-406b-9e5c-76dff4966153 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:16.658351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-deaf66c9-f709-4603-9fd2-9891585213a0 tempest-AttachVolumeTestJSON-372899460 tempest-AttachVolumeTestJSON-372899460-project] 10.222.0.75 "GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153" status: 404 len: 111 microversion: 2.1 time: 0.029207 May 17 16:00:16.658351 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 546/1089] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:16 2022] GET /compute/v2.1/servers/e015bc8e-5811-406b-9e5c-76dff4966153 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:00:20.877813 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-916139ee-39c4-42d8-90cc-6cf170b483dc tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Action: 'create', calling method: .version_select at 0x7f83f72dfdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-142329984", "metadata": {"Type": "work"}}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-916139ee-39c4-42d8-90cc-6cf170b483dc tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Request method failure captured: May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 121 May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8aUJDB87MeU1OEcniXtZxpTj5lfmSczrY2mVdT2WnFvFIDvVDBbW46_qodu_fyvyS1ntwsog09NTuWL6hGurjczLLj5pQxIY9Zq3oF5aeIH2l8QYKtn1frHyD_onZu2xbQCEbtvwnm3khIXpzA_j2cM3lCjM_vfAflcuKR8l_mLAXA May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:00:20.891714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0193131753454d8689027a7401ac5617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0193131753454d8689027a7401ac5617"}]}] May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 30197f373c414492848c5545646272fd May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-142329984", "metadata": {"Type": "work"}}} May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: May 17 16:00:20.893455 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-142329984', 'metadata': {'Type': 'work'}}}} May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise error May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi '#$%' May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:20.894738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 16:00:20.896915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 16:00:20.899132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 16:00:20.899132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.899132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-916139ee-39c4-42d8-90cc-6cf170b483dc tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:20.899132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-916139ee-39c4-42d8-90cc-6cf170b483dc tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125179 May 17 16:00:20.899132 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 544/1090] 10.222.0.75 () {60 vars in 1155 bytes} [Tue May 17 16:00:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 16:00:20.904587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-823a479d-c48a-4ded-87e4-6101e8650f59 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Action: 'create', calling method: .version_select at 0x7f8400615dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-625479647", "metadata": {"Type": "work"}}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-823a479d-c48a-4ded-87e4-6101e8650f59 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Request method failure captured: May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 119 May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8aUJDB87MeU1OEcniXtZxpTj5lfmSczrY2mVdT2WnFvFIDvVDBbW46_qodu_fyvyS1ntwsog09NTuWL6hGurjczLLj5pQxIY9Zq3oF5aeIH2l8QYKtn1frHyD_onZu2xbQCEbtvwnm3khIXpzA_j2cM3lCjM_vfAflcuKR8l_mLAXA May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:00:20.907772 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0193131753454d8689027a7401ac5617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0193131753454d8689027a7401ac5617"}]}] May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 30197f373c414492848c5545646272fd May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-625479647", "metadata": {"Type": "work"}}} May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: May 17 16:00:20.909394 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-625479647', 'metadata': {'Type': 'work'}}}} May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise error May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi '0' May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:20.912131 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 16:00:20.913769 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 16:00:20.915224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 16:00:20.915224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.915224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-823a479d-c48a-4ded-87e4-6101e8650f59 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:20.915224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-823a479d-c48a-4ded-87e4-6101e8650f59 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008456 May 17 16:00:20.915224 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 547/1091] 10.222.0.75 () {60 vars in 1155 bytes} [Tue May 17 16:00:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 16:00:20.919048 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-69f7e85b-ed46-4805-82a8-11e7c3e3af55 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Action: 'create', calling method: .version_select at 0x7f83f7230550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1398458518", "metadata": {"Type": "work"}}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-69f7e85b-ed46-4805-82a8-11e7c3e3af55 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Request method failure captured: May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 119 May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8aUJDB87MeU1OEcniXtZxpTj5lfmSczrY2mVdT2WnFvFIDvVDBbW46_qodu_fyvyS1ntwsog09NTuWL6hGurjczLLj5pQxIY9Zq3oF5aeIH2l8QYKtn1frHyD_onZu2xbQCEbtvwnm3khIXpzA_j2cM3lCjM_vfAflcuKR8l_mLAXA May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:00:20.921333 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0193131753454d8689027a7401ac5617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0193131753454d8689027a7401ac5617"}]}] May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 30197f373c414492848c5545646272fd May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1398458518", "metadata": {"Type": "work"}}} May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: May 17 16:00:20.922948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1398458518', 'metadata': {'Type': 'work'}}}} May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise error May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi '' May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:20.924111 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 16:00:20.925874 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 16:00:20.927583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 16:00:20.927583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:20.927583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-69f7e85b-ed46-4805-82a8-11e7c3e3af55 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:20.927583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-69f7e85b-ed46-4805-82a8-11e7c3e3af55 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008350 May 17 16:00:20.927583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 545/1092] 10.222.0.75 () {60 vars in 1155 bytes} [Tue May 17 16:00:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 16:00:20.931762 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ff6f25f4-9e83-4ce1-91d1-7406986b37c2 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Calling method '.version_select at 0x7f84006379d0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:20.959894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-ff6f25f4-9e83-4ce1-91d1-7406986b37c2 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] HTTP exception thrown: Volume tempest-invalid-278532156 could not be found. May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ff6f25f4-9e83-4ce1-91d1-7406986b37c2 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Request method failure captured: May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-278532156 HTTP/1.1 May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8aUJDB87MeU1OEcniXtZxpTj5lfmSczrY2mVdT2WnFvFIDvVDBbW46_qodu_fyvyS1ntwsog09NTuWL6hGurjczLLj5pQxIY9Zq3oF5aeIH2l8QYKtn1frHyD_onZu2xbQCEbtvwnm3khIXpzA_j2cM3lCjM_vfAflcuKR8l_mLAXA May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:00:20.962437 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0193131753454d8689027a7401ac5617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0193131753454d8689027a7401ac5617"}]}] May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 30197f373c414492848c5545646272fd May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesNegativeTest-834614117-project May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Volume tempest-invalid-278532156 could not be found. May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': 'tempest-invalid-278532156'} May 17 16:00:20.964184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-278532156 could not be found. (HTTP 404) (Request-ID: req-742f6776-97ed-4bde-9e7b-f7bfb60f16a9) May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.966345 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 16:00:20.967643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-278532156 could not be found. May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:20.968904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-278532156 could not be found. May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-278532156 could not be found. May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ff6f25f4-9e83-4ce1-91d1-7406986b37c2 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Returning 404 to user: Volume tempest-invalid-278532156 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ff6f25f4-9e83-4ce1-91d1-7406986b37c2 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-278532156" status: 404 len: 98 microversion: 2.1 time: 0.036156 May 17 16:00:20.970569 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 548/1093] 10.222.0.75 () {58 vars in 1214 bytes} [Tue May 17 16:00:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-278532156 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 17 16:00:20.973276 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d353346c-527c-4305-98b9-d500c815f561 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003720 May 17 16:00:20.973898 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 546/1094] 10.222.0.75 () {58 vars in 1139 bytes} [Tue May 17 16:00:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 16:00:20.981908 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-07cda8a5-5ba9-411d-ab07-067946c6a6a4 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003671 May 17 16:00:20.982442 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 549/1095] 10.222.0.75 () {58 vars in 1136 bytes} [Tue May 17 16:00:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 16:00:20.989991 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-09b4d914-f20b-44f1-bb25-497c79b15575 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Calling method '.version_select at 0x7f83f72df310>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:21.017133 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-09b4d914-f20b-44f1-bb25-497c79b15575 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] HTTP exception thrown: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-09b4d914-f20b-44f1-bb25-497c79b15575 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Request method failure captured: May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/os-volumes/2c1cfabc-1652-457d-a9ce-cd92c1e1f116 HTTP/1.1 May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8aUJDB87MeU1OEcniXtZxpTj5lfmSczrY2mVdT2WnFvFIDvVDBbW46_qodu_fyvyS1ntwsog09NTuWL6hGurjczLLj5pQxIY9Zq3oF5aeIH2l8QYKtn1frHyD_onZu2xbQCEbtvwnm3khIXpzA_j2cM3lCjM_vfAflcuKR8l_mLAXA May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:00:21.019077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0193131753454d8689027a7401ac5617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0193131753454d8689027a7401ac5617"}]}] May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesNegativeTest-834614117 May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesNegativeTest-834614117-project May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 30197f373c414492848c5545646272fd May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesNegativeTest-834614117-project May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '2c1cfabc-1652-457d-a9ce-cd92c1e1f116'} May 17 16:00:21.020736 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. (HTTP 404) (Request-ID: req-75b484b6-bc93-428d-96c1-47d8e6743cf2) May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:21.021903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 16:00:21.023395 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 16:00:21.025012 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-09b4d914-f20b-44f1-bb25-497c79b15575 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Returning 404 to user: Volume 2c1cfabc-1652-457d-a9ce-cd92c1e1f116 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-09b4d914-f20b-44f1-bb25-497c79b15575 tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/2c1cfabc-1652-457d-a9ce-cd92c1e1f116" status: 404 len: 109 microversion: 2.1 time: 0.033759 May 17 16:00:21.026690 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 547/1096] 10.222.0.75 () {58 vars in 1247 bytes} [Tue May 17 16:00:20 2022] DELETE /compute/v2.1/os-volumes/2c1cfabc-1652-457d-a9ce-cd92c1e1f116 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 16:00:21.030625 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0c44fac7-7d51-48aa-a293-2fdcca3c6a2f tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Calling method '.version_select at 0x7f840060fca0>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:21.056975 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-0c44fac7-7d51-48aa-a293-2fdcca3c6a2f tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] HTTP exception thrown: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0c44fac7-7d51-48aa-a293-2fdcca3c6a2f tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Request method failure captured: May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/os-volumes/3ad8295c-08a3-422b-8f20-c2ca7631a965 HTTP/1.1 May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8aUJDB87MeU1OEcniXtZxpTj5lfmSczrY2mVdT2WnFvFIDvVDBbW46_qodu_fyvyS1ntwsog09NTuWL6hGurjczLLj5pQxIY9Zq3oF5aeIH2l8QYKtn1frHyD_onZu2xbQCEbtvwnm3khIXpzA_j2cM3lCjM_vfAflcuKR8l_mLAXA May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:00:21.058951 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0193131753454d8689027a7401ac5617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0193131753454d8689027a7401ac5617"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0193131753454d8689027a7401ac5617"}]}] May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesNegativeTest-834614117 May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: 0193131753454d8689027a7401ac5617 May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesNegativeTest-834614117 May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesNegativeTest-834614117-project May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 30197f373c414492848c5545646272fd May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesNegativeTest-834614117-project May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '3ad8295c-08a3-422b-8f20-c2ca7631a965'} May 17 16:00:21.060581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. (HTTP 404) (Request-ID: req-10764743-e4ba-45db-ac4c-5eb2e50239fb) May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:21.061627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 16:00:21.063172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 16:00:21.065532 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0c44fac7-7d51-48aa-a293-2fdcca3c6a2f tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] Returning 404 to user: Volume 3ad8295c-08a3-422b-8f20-c2ca7631a965 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0c44fac7-7d51-48aa-a293-2fdcca3c6a2f tempest-VolumesNegativeTest-834614117 tempest-VolumesNegativeTest-834614117-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/3ad8295c-08a3-422b-8f20-c2ca7631a965" status: 404 len: 109 microversion: 2.1 time: 0.033453 May 17 16:00:21.066979 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 550/1097] 10.222.0.75 () {58 vars in 1244 bytes} [Tue May 17 16:00:21 2022] GET /compute/v2.1/os-volumes/3ad8295c-08a3-422b-8f20-c2ca7631a965 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 16:00:56.612229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-427676590", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "networks": [{"uuid": "c338d75b-ea08-46a5-8585-b0871783daf7"}]}} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:00:56.667806 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.network.neutron [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] validate_networks() for [('c338d75b-ea08-46a5-8585-b0871783daf7', None, None, None, None, None)] {{(pid=123908) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 16:00:57.039918 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Flavor limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 16:00:57.040349 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Image limits 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 16:00:57.040827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Flavor pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 16:00:57.041239 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Image pref 0:0:0 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 16:00:57.041654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.virt.hardware [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 16:00:57.050385 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:57.050827 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:57.051619 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:57.052051 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:57.068653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Getting quotas for project e2d2f895d6cb4e218216aa316538d046. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 16:00:57.073152 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.quota [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Getting quotas for user 67020a523bd14f3689b3349492c90337 and project e2d2f895d6cb4e218216aa316538d046. Resources: {'cores', 'instances', 'ram'} {{(pid=123908) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 16:00:57.083629 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Going to run 1 instances... {{(pid=123908) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 16:00:57.085848 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 16:00:57.130453 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c749d378-44bd-42e8-84ce-8638158ae5b9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524953 May 17 16:00:57.131088 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 548/1098] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 16:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 16:00:57.142887 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-81e385d3-300b-40da-aad1-bd6d7c76a52d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:57.143524 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-81e385d3-300b-40da-aad1-bd6d7c76a52d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:57.200775 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-81e385d3-300b-40da-aad1-bd6d7c76a52d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:00:57.207341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-81e385d3-300b-40da-aad1-bd6d7c76a52d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1218 microversion: 2.1 time: 0.069713 May 17 16:00:57.207909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 551/1099] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:57 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:00:58.225805 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:58.226440 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:58.233058 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:58.233781 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:58.234606 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:58.235049 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:58.306406 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:00:58.315375 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-daf62c5f-a08a-4db1-a429-80986035c33a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1276 microversion: 2.1 time: 0.094503 May 17 16:00:58.315965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 549/1100] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:58 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:00:59.334027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:00:59.334657 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:00:59.341058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:59.341511 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:59.342359 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:59.342747 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:59.374601 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-df86a936-014f-43de-920e-d4730a31a643 req-e562726a-18a2-430f-847e-e7840358ec85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a879392e-422c-4d02-b3f1-9167eabf069d", "tag": "b8b63290-7236-4427-810a-77eeec6119e4"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:00:59.387501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-df86a936-014f-43de-920e-d4730a31a643 req-e562726a-18a2-430f-847e-e7840358ec85 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:00:59.388434 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-df86a936-014f-43de-920e-d4730a31a643 req-e562726a-18a2-430f-847e-e7840358ec85 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:00:59.400713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-df86a936-014f-43de-920e-d4730a31a643 req-e562726a-18a2-430f-847e-e7840358ec85 service nova] Creating event network-changed:b8b63290-7236-4427-810a-77eeec6119e4 for instance a879392e-422c-4d02-b3f1-9167eabf069d on hv-cinder-84212 May 17 16:00:59.406240 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-df86a936-014f-43de-920e-d4730a31a643 req-e562726a-18a2-430f-847e-e7840358ec85 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035197 May 17 16:00:59.406896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 550/1101] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 16:00:59.576322 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:00:59.583643 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-21506383-d2ad-4704-a8b0-135bc90ef7ab tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.253450 May 17 16:00:59.584302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 552/1102] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:00:59 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:00.601009 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:00.601624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:00.608528 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:00.608981 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:00.609750 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:00.610224 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:00.739777 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:00.747583 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-43e5a045-6878-41ef-b388-2d84da20e198 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.150878 May 17 16:01:00.748153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 551/1103] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:00 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:01.764430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:01.765053 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:01.771659 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:01.772150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:01.772923 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:01.773362 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:01.899517 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:01.906791 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ed234003-ec63-4cdb-a8d8-bb4d8f8cb4fd tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.146259 May 17 16:01:01.907366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 553/1104] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:01 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:02.923744 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:02.924389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:02.930716 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:02.931161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:02.931922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:02.932351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:03.055782 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:03.062942 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1b758cbb-f2ab-469e-8ae3-f42e56168887 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.143030 May 17 16:01:03.063508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 552/1105] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:02 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:04.080302 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:04.080916 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:04.087969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:04.088426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:04.089232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:04.089692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:04.222926 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:04.230826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-fd76d845-d129-4452-93d6-9fc803dca0da tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.154329 May 17 16:01:04.231406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 554/1106] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:04 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:05.248279 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:05.248921 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:05.254952 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:05.255400 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:05.256161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:05.257233 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:05.378237 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:05.385925 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-3daf06dd-1a1b-4948-888c-9c006878efa0 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.141471 May 17 16:01:05.386519 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 553/1107] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:05 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:06.360175 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-9a7753f8-84b3-4e0a-9deb-4500217dae6a req-e313387d-bbc7-4f1a-8f68-af2e27c23b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a879392e-422c-4d02-b3f1-9167eabf069d", "name": "network-vif-plugged", "status": "completed", "tag": "b8b63290-7236-4427-810a-77eeec6119e4"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:01:06.368161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-9a7753f8-84b3-4e0a-9deb-4500217dae6a req-e313387d-bbc7-4f1a-8f68-af2e27c23b72 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:06.368607 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-9a7753f8-84b3-4e0a-9deb-4500217dae6a req-e313387d-bbc7-4f1a-8f68-af2e27c23b72 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:06.379226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-9a7753f8-84b3-4e0a-9deb-4500217dae6a req-e313387d-bbc7-4f1a-8f68-af2e27c23b72 service nova] Creating event network-vif-plugged:b8b63290-7236-4427-810a-77eeec6119e4 for instance a879392e-422c-4d02-b3f1-9167eabf069d on hv-cinder-84212 May 17 16:01:06.384678 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-9a7753f8-84b3-4e0a-9deb-4500217dae6a req-e313387d-bbc7-4f1a-8f68-af2e27c23b72 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142463 May 17 16:01:06.385245 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 555/1108] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:01:06.403243 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:06.403863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:06.410273 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:06.410735 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:06.411517 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:06.411960 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:06.575312 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:06.582748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c03f4331-947f-44bb-971d-2cb6e783ccb6 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.183326 May 17 16:01:06.583416 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 554/1109] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:06 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:07.601645 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:07.602375 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:07.608775 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:07.609232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:07.610027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:07.610470 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:07.734824 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:07.742116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b0d75ba4-a8f8-4e98-84a8-0cd655dcdde5 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1318 microversion: 2.1 time: 0.145733 May 17 16:01:07.742687 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 556/1110] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:07 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:08.758654 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:08.759274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:08.767508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:08.768046 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:08.768962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:08.769413 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:08.900471 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:08.907817 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-dc56d7df-b664-4213-92dc-60067b08a583 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1507 microversion: 2.1 time: 0.153153 May 17 16:01:08.908489 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 555/1111] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:08 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:31.358249 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68fb78e9-2265-4885-823e-811a2f89ce2f", "device": "/dev/sdb"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:01:31.359834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:31.365699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:31.366192 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:31.366954 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:31.367391 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:31.593484 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-7b97023b-88ea-4467-a8a1-dd0afcb9d17c tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "POST /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239398 May 17 16:01:31.594163 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 557/1112] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 16:01:31 2022] POST /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:01:34.466205 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:34.466772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:34.473311 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:34.473767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:34.474565 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:34.474998 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:34.499802 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 16:01:34.571907 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-7949a6c4-e513-416c-9000-d68555682e19 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "DELETE /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 204 len: 0 microversion: 2.1 time: 0.109659 May 17 16:01:34.572523 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 556/1113] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:01:34 2022] DELETE /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 16:01:34.581767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:34.582503 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:34.588767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:34.589229 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:34.590027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:34.590478 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:34.718414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:34.726349 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-18135c0a-b673-451c-91c5-f33cc9795113 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1573 microversion: 2.1 time: 0.149269 May 17 16:01:34.726936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 558/1114] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:34 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:35.744387 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:35.745084 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:35.751071 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:35.751521 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:35.752285 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:35.752721 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:35.887623 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:35.895052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e247dd04-9fe2-4207-a7f0-442bdbb2d0b5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1573 microversion: 2.1 time: 0.155029 May 17 16:01:35.895624 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 557/1115] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:35 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:36.913164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:36.913783 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:36.921024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:36.921479 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:36.922288 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:36.922731 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:37.008213 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:37.016244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1dd4cab5-b9f0-4584-897d-df7ea4ea1519 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1506 microversion: 2.1 time: 0.107470 May 17 16:01:37.021627 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 559/1116] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:36 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1506 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:37.074405 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-f12b34f2-2900-4c85-b0c0-14caec8e2d3a req-852d5067-8dbd-4a2e-aa80-76180484f15c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "453bba5c-49db-439a-8ff8-095ff05a6d3f", "name": "network-vif-deleted", "tag": "05eade37-4ca5-4a52-8b62-e077ce332ef1"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:01:37.082869 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-f12b34f2-2900-4c85-b0c0-14caec8e2d3a req-852d5067-8dbd-4a2e-aa80-76180484f15c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:37.083389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-f12b34f2-2900-4c85-b0c0-14caec8e2d3a req-852d5067-8dbd-4a2e-aa80-76180484f15c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:37.094603 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-f12b34f2-2900-4c85-b0c0-14caec8e2d3a req-852d5067-8dbd-4a2e-aa80-76180484f15c service nova] Creating event network-vif-deleted:05eade37-4ca5-4a52-8b62-e077ce332ef1 for instance 453bba5c-49db-439a-8ff8-095ff05a6d3f on hv-cinder-84212 May 17 16:01:37.100218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-f12b34f2-2900-4c85-b0c0-14caec8e2d3a req-852d5067-8dbd-4a2e-aa80-76180484f15c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028976 May 17 16:01:37.101047 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 558/1117] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:01:38.033723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:38.034319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:38.041795 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:38.042803 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:38.043059 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:38.043501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:38.078502 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:38.079109 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:38.079587 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lazy-loading 'fault' on Instance uuid 453bba5c-49db-439a-8ff8-095ff05a6d3f {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:01:38.121811 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:38.129229 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b1e49697-6134-4fec-9266-6b1081064c82 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 200 len: 1228 microversion: 2.1 time: 0.099554 May 17 16:01:38.129810 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 560/1118] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:38 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:39.150809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:39.151508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:39.158627 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:39.159151 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:39.159948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:39.160392 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:39.176077 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] HTTP exception thrown: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Request method failure captured: May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f HTTP/1.1 May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8Yjw-Z9vHYf1lqbQmseMqFA_f8jT6xOlAaaJBw90HVo41jPvaQqV-1M_ryhOfRSYlrYe9yixjH_ikPoeXaTlO-5DKQnTo4bwB2TO6rgZj7STrUWBA-xWo2ejixx4Zi0TgFq-p5rNb0DDIHIqKXnaOr2TWVzp-Ys2XyKvgGLQS-FDYo May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:01:39.177948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fbe368679f4c4d968619ea0e2456c407"}]}] May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-TestVolumeBootPattern-2025100078 May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-TestVolumeBootPattern-2025100078-project May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 3df48c5aad0f4cb5aeb7c76d82ab0b4b May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-TestVolumeBootPattern-2025100078-project May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:01:39.179844 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '453bba5c-49db-439a-8ff8-095ff05a6d3f'} May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:01:39.181095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:01:39.182774 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:01:39.184229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Returning 404 to user: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:01:39.184229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-b72e7054-26aa-491f-a9ef-4c13b58ac1ba tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 404 len: 111 microversion: 2.1 time: 0.033766 May 17 16:01:39.184229 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 559/1119] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:39 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:01:39.288329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1943122001", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327864240", "security_groups": [{"name": "tempest-secgroup-smoke-252411881"}], "block_device_mapping_v2": [{"uuid": "cdb1339b-0f24-4703-acb1-99a6e0a8e1e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f4eb954-5185-441c-9dd5-cd8454980b48"}]}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:01:39.396732 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] validate_networks() for [('6f4eb954-5185-441c-9dd5-cd8454980b48', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 16:01:39.796894 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 16:01:39.797317 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 16:01:39.797849 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 16:01:39.798294 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 16:01:39.798711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 16:01:39.807909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:39.808490 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:39.809673 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:39.810341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:39.827344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for project fbe368679f4c4d968619ea0e2456c407. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 16:01:39.831215 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for user 3df48c5aad0f4cb5aeb7c76d82ab0b4b and project fbe368679f4c4d968619ea0e2456c407. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 16:01:39.886387 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 16:01:39.888626 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdb1339b-0f24-4703-acb1-99a6e0a8e1e9',volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 16:01:40.011033 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-9d98a5bd-dadb-47b5-8b18-82ebe5ee1da5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.726730 May 17 16:01:40.011679 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 561/1120] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 16:01:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 16:01:40.021615 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-aa7c51bd-f663-47a7-8d37-a44b2569976d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:40.022334 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-aa7c51bd-f663-47a7-8d37-a44b2569976d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:40.074681 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-aa7c51bd-f663-47a7-8d37-a44b2569976d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:40.081202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-aa7c51bd-f663-47a7-8d37-a44b2569976d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1094 microversion: 2.1 time: 0.063557 May 17 16:01:40.081764 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 560/1121] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:40 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:41.098076 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3caca950-464a-4a18-9ee7-9538ce117b67 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:41.098835 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3caca950-464a-4a18-9ee7-9538ce117b67 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:41.151087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3caca950-464a-4a18-9ee7-9538ce117b67 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:41.157527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3caca950-464a-4a18-9ee7-9538ce117b67 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1094 microversion: 2.1 time: 0.063755 May 17 16:01:41.158102 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 562/1122] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:41 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:42.173575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6c0a23ee-be8c-4081-8288-ce4162b67067 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:42.174235 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6c0a23ee-be8c-4081-8288-ce4162b67067 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:42.230157 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6c0a23ee-be8c-4081-8288-ce4162b67067 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:42.237090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6c0a23ee-be8c-4081-8288-ce4162b67067 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1094 microversion: 2.1 time: 0.067288 May 17 16:01:42.237674 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 561/1123] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:42 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:43.254330 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0e68aaf7-079c-48f5-b4ec-6b7ceb594d1a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:43.255168 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0e68aaf7-079c-48f5-b4ec-6b7ceb594d1a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:43.307848 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-0e68aaf7-079c-48f5-b4ec-6b7ceb594d1a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:43.314591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0e68aaf7-079c-48f5-b4ec-6b7ceb594d1a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1094 microversion: 2.1 time: 0.064087 May 17 16:01:43.315171 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 563/1124] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:43 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:44.331199 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:44.331850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:44.338217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:44.338668 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:44.339436 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:44.339873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:44.401319 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:44.410470 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a4b81ee5-c199-4ee0-b624-f85e7cda73cf tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1144 microversion: 2.1 time: 0.082994 May 17 16:01:44.411336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 562/1125] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:44 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:45.427258 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:45.427800 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:45.434707 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:45.435201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:45.435973 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:45.436414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:45.496271 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:45.503417 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-eb5c79bd-9721-43e2-b7d8-815ee4713680 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1200 microversion: 2.1 time: 0.080096 May 17 16:01:45.503985 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 564/1126] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:45 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1200 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:46.521448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:46.521985 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:46.528351 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:46.528791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:46.529545 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:46.529973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:46.594284 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:46.602419 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c52f499d-abdc-48b0-b47e-e8035cefdca0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1200 microversion: 2.1 time: 0.085436 May 17 16:01:46.602984 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 563/1127] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:46 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:47.619158 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:47.619774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:47.626151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:47.626600 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:47.627367 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:47.627801 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:47.688071 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:47.695768 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-175965b4-0852-4722-b8ec-4e83fbed9c0f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1200 microversion: 2.1 time: 0.080445 May 17 16:01:47.696329 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 565/1128] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:47 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1200 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:48.712750 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:48.713360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:48.719932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:48.720389 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:48.721161 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:48.721600 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:48.793589 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:48.800903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-70b4bf96-a3e1-4dbe-9a00-09c31c477578 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1210 microversion: 2.1 time: 0.092516 May 17 16:01:48.801466 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 564/1129] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:48 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:49.632161 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-e74cc99a-fa8b-4b72-bed0-5d80bfb8b540 req-fe95a719-1549-456a-941d-72b3fd0150c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c6b3b9-82e1-42fa-9a41-bb5a2579607e", "tag": "e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:01:49.641451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e74cc99a-fa8b-4b72-bed0-5d80bfb8b540 req-fe95a719-1549-456a-941d-72b3fd0150c5 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:49.641903 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-e74cc99a-fa8b-4b72-bed0-5d80bfb8b540 req-fe95a719-1549-456a-941d-72b3fd0150c5 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:49.653406 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-e74cc99a-fa8b-4b72-bed0-5d80bfb8b540 req-fe95a719-1549-456a-941d-72b3fd0150c5 service nova] Creating event network-changed:e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4 for instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e on hv-cinder-84212 May 17 16:01:49.659498 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-e74cc99a-fa8b-4b72-bed0-5d80bfb8b540 req-fe95a719-1549-456a-941d-72b3fd0150c5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032675 May 17 16:01:49.660419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 566/1130] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:01:49.818913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:49.819527 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:49.827559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:49.828128 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:49.829816 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:49.830505 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:50.038238 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:50.045573 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1a52b970-9736-4ad5-a031-a793f8c4a204 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.230456 May 17 16:01:50.046169 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 565/1131] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:49 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:51.063541 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:51.064250 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:51.071162 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:51.071622 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:51.072401 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:51.072849 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:51.198843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:51.206262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-52682d1b-465b-497c-a24f-a76d2b2fb096 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.147380 May 17 16:01:51.206833 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 567/1132] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:51 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:52.223260 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:52.224307 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:52.230645 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:52.231097 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:52.232108 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:52.232551 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:52.357178 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:52.364965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-2469d1a2-2a9d-4523-aa00-6eb1becde016 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.145166 May 17 16:01:52.365535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 566/1133] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:52 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 16:01:53.387049 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:53.387601 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:53.394170 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:53.394628 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:53.395407 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:53.395846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:53.523619 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:53.530930 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-5af3fb81-41a1-44fc-953e-0769bbdf0b68 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.147792 May 17 16:01:53.531500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 568/1134] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:53 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:54.548137 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:54.548754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:54.555069 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:54.555516 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:54.556274 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:54.556701 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:54.686180 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:54.693962 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8b0a36f4-f309-4731-9385-2dd7a8111a13 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.149707 May 17 16:01:54.694555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 567/1135] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:54 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:55.711488 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:55.712104 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:55.718516 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:55.718969 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:55.719738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:55.720175 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:55.895864 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:55.903106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c6566976-df5d-4128-b58d-0c2bafdc9b1d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.196026 May 17 16:01:55.903673 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 569/1136] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:55 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:56.921045 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:56.921692 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:56.928402 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:56.928855 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:56.929632 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:56.930092 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:57.062801 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:57.070671 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-1590c026-70df-4d0c-9506-adf72dc86bf6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.153553 May 17 16:01:57.071207 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 568/1137] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:56 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:58.087716 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:58.088344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:58.094782 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:58.095242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:58.096015 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:58.096457 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:58.222021 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:58.231473 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4c623c6e-7fa6-4baa-8aa2-90280f80bcb6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.148105 May 17 16:01:58.232316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 570/1138] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:58 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 16:01:58.325551 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:58.326053 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:58.332579 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:58.333029 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:58.333794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:58.334255 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:58.412784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lazy-loading 'services' on Instance uuid a879392e-422c-4d02-b3f1-9167eabf069d {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:01:58.482157 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d3a2ee91-5c3d-4158-94d7-7d760b87be82 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d/os-volume_attachments/68fb78e9-2265-4885-823e-811a2f89ce2f" status: 202 len: 0 microversion: 2.1 time: 0.160130 May 17 16:01:58.482766 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 569/1139] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 16:01:58 2022] DELETE /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d/os-volume_attachments/68fb78e9-2265-4885-823e-811a2f89ce2f => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 16:01:59.248785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:59.249319 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:59.255722 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:59.256176 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:59.256952 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:59.257395 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:59.386766 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:59.394110 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-d5e65234-2b70-4353-aae5-8aa7dad32b8e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.149312 May 17 16:01:59.394686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 571/1140] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:59 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:01:59.592767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:59.593354 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:59.599552 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:59.600005 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:59.600772 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:59.601218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:59.625365 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 16:01:59.701763 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-d13db2ed-44e6-4992-afa9-89acc3e06bfc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 204 len: 0 microversion: 2.1 time: 0.113086 May 17 16:01:59.702435 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 570/1141] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:01:59 2022] DELETE /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 16:01:59.711226 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:01:59.711846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:01:59.717780 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:59.718280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:59.719056 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:01:59.719501 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:01:59.845462 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:01:59.852722 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-19dcb14e-5230-4971-a8fd-459ca0ea0bd9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1513 microversion: 2.1 time: 0.146058 May 17 16:01:59.853291 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 572/1142] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:01:59 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 16:02:00.411297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:00.411965 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:00.417901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:00.418414 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:00.419185 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:00.419625 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:00.546410 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:00.553922 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a6cc3067-6ad0-4142-b61b-e501827eafde tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.146989 May 17 16:02:00.554511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 571/1143] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:00 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:00.870648 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:00.871268 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:00.877578 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:00.878058 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:00.878834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:00.879273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:01.010082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:01.017508 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6141bed0-f06b-4422-94ec-6e7a55c8ba34 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1513 microversion: 2.1 time: 0.150773 May 17 16:02:01.018098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 573/1144] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:00 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:01.570771 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:01.571305 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:01.577733 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:01.578212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:01.578972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:01.579426 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:01.704723 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:01.712560 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c596ea45-16b6-4fa2-a59b-31d3eeab9443 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.145908 May 17 16:02:01.713116 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 572/1145] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:01 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:02.034692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:02.035341 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:02.041692 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:02.042196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:02.042974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:02.043419 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:02.171116 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:02.178500 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a9badb02-7f2e-45d4-ad73-cfc0616b7e98 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 200 len: 1513 microversion: 2.1 time: 0.147773 May 17 16:02:02.179077 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 574/1146] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:02 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:02.643384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:02:02.643976 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 16:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:02:02.730289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:02.730906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:02.738713 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:02.739153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:02.740822 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:02.741262 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:02.760789 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-41769088-7bcf-42e7-9916-20a3eb8f127e req-b6b5b796-b730-4117-9680-2731cd79edf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a879392e-422c-4d02-b3f1-9167eabf069d", "name": "network-vif-deleted", "tag": "b8b63290-7236-4427-810a-77eeec6119e4"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:02.773723 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-41769088-7bcf-42e7-9916-20a3eb8f127e req-b6b5b796-b730-4117-9680-2731cd79edf7 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:02.774372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-41769088-7bcf-42e7-9916-20a3eb8f127e req-b6b5b796-b730-4117-9680-2731cd79edf7 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:02.788424 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-41769088-7bcf-42e7-9916-20a3eb8f127e req-b6b5b796-b730-4117-9680-2731cd79edf7 service nova] Creating event network-vif-deleted:b8b63290-7236-4427-810a-77eeec6119e4 for instance a879392e-422c-4d02-b3f1-9167eabf069d on hv-cinder-84212 May 17 16:02:02.793758 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-41769088-7bcf-42e7-9916-20a3eb8f127e req-b6b5b796-b730-4117-9680-2731cd79edf7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036581 May 17 16:02:02.794404 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 575/1147] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 16:02:02.885698 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:02.893727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-e4e1d298-e38a-4efc-9d8b-0a7eb887eb92 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.168849 May 17 16:02:02.894369 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 573/1148] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:02 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:03.197270 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:03.198087 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a879392e-422c-4d02-b3f1-9167eabf069d] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:03.205125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:03.205892 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:03.206776 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:03.207216 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:03.221223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] HTTP exception thrown: Instance a879392e-422c-4d02-b3f1-9167eabf069d could not be found. May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Request method failure captured: May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d HTTP/1.1 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8a37qv_n2yhwx-jXGb5K2PwRpNVp4AbMUbYSzk7k1xhMUt1RYQqAccGBTXI0vWRRkjwc1vvhQ7YHsmZjxHRhCTpAB1vrZlyg1savhGCQK0mNPezVMe8Ennb2PYq42b63NKV4KGdh-X6D352hOO7HVVwrrNKVFnLmP48iJO7123P6O8 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: e2d2f895d6cb4e218216aa316538d046 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-VolumesSnapshotTestJSON-436094553 May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:02:03.222902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e2d2f895d6cb4e218216aa316538d046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e2d2f895d6cb4e218216aa316538d046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e2d2f895d6cb4e218216aa316538d046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e2d2f895d6cb4e218216aa316538d046"}]}] May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-VolumesSnapshotTestJSON-436094553 May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: e2d2f895d6cb4e218216aa316538d046 May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-436094553 May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-VolumesSnapshotTestJSON-436094553-project May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 67020a523bd14f3689b3349492c90337 May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-VolumesSnapshotTestJSON-436094553-project May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance a879392e-422c-4d02-b3f1-9167eabf069d could not be found. May 17 16:02:03.225223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': 'a879392e-422c-4d02-b3f1-9167eabf069d'} May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a879392e-422c-4d02-b3f1-9167eabf069d could not be found. May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:02:03.226201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a879392e-422c-4d02-b3f1-9167eabf069d could not be found. May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a879392e-422c-4d02-b3f1-9167eabf069d could not be found. May 17 16:02:03.227558 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:02:03.229748 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Returning 404 to user: Instance a879392e-422c-4d02-b3f1-9167eabf069d could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:02:03.230630 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-8da27a84-136c-4538-8ece-0dea28fdc698 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d" status: 404 len: 111 microversion: 2.1 time: 0.038639 May 17 16:02:03.231196 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 576/1149] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:03 2022] GET /compute/v2.1/servers/a879392e-422c-4d02-b3f1-9167eabf069d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:02:03.910972 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:03.911614 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:03.917878 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:03.918381 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:03.919165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:03.919595 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:04.059361 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:04.066739 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-589eac35-f3b1-4800-ad26-10558ffabe3d tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.159626 May 17 16:02:04.067917 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 574/1150] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:03 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:05.058930 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-cdefb87e-e35d-40df-9482-c98e65bd070d req-e61a4a7c-49ea-424c-b571-9a93c0634431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c6b3b9-82e1-42fa-9a41-bb5a2579607e", "name": "network-vif-plugged", "status": "completed", "tag": "e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:05.067819 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-cdefb87e-e35d-40df-9482-c98e65bd070d req-e61a4a7c-49ea-424c-b571-9a93c0634431 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:05.068426 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-cdefb87e-e35d-40df-9482-c98e65bd070d req-e61a4a7c-49ea-424c-b571-9a93c0634431 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:05.080324 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-cdefb87e-e35d-40df-9482-c98e65bd070d req-e61a4a7c-49ea-424c-b571-9a93c0634431 service nova] Creating event network-vif-plugged:e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4 for instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e on hv-cinder-84212 May 17 16:02:05.084360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:05.085204 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:05.085675 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-cdefb87e-e35d-40df-9482-c98e65bd070d req-e61a4a7c-49ea-424c-b571-9a93c0634431 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 May 17 16:02:05.086465 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 577/1151] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:02:05.091936 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:05.092476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:05.093463 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:05.093903 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:05.226729 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:05.234359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f80330b7-8793-4ef3-8445-13389541e8db tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.154581 May 17 16:02:05.234954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 575/1152] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:05 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:06.252588 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:06.253280 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:06.260064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:06.260513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:06.261273 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:06.261711 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:06.391804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:06.399872 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-56e5dbba-cebd-417b-9ef8-ed2b2854ae59 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.152059 May 17 16:02:06.400449 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 578/1153] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:06 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:07.416472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:07.417082 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:07.423476 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:07.423926 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:07.424687 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:07.425117 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:07.559035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:07.566974 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-79bf6100-0851-44ee-b61f-3225877fa339 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.154249 May 17 16:02:07.568106 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 576/1154] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:07 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:08.585246 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:08.585767 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:08.592167 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:08.592629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:08.593405 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:08.593847 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:08.721357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:08.728904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c2791f89-f713-40ea-bc8e-b7b73d46ed91 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1265 microversion: 2.1 time: 0.148199 May 17 16:02:08.729570 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 579/1155] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:08 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:09.745944 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:09.746620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:09.752954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:09.753407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:09.754202 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:09.754643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:09.880652 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:09.888126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-5f50488e-54af-402e-bdda-899b012c4d79 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1452 microversion: 2.1 time: 0.146085 May 17 16:02:09.888694 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 577/1156] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:09 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:09.904527 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:09.905143 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:09.912164 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:09.912580 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:09.913356 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:09.913796 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:10.048581 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:10.055980 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-4890e8b1-2b87-4ac4-8f40-8a3f97a0bc4a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1452 microversion: 2.1 time: 0.155257 May 17 16:02:10.056578 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 580/1157] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:09 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:11.896639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-3cb9c240-8b04-443f-92a7-8b511c642352 req-81c2c48d-b1dc-4eb9-80d7-c9f90b3ebea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c6b3b9-82e1-42fa-9a41-bb5a2579607e", "tag": "e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:11.904587 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-3cb9c240-8b04-443f-92a7-8b511c642352 req-81c2c48d-b1dc-4eb9-80d7-c9f90b3ebea0 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:11.905038 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-3cb9c240-8b04-443f-92a7-8b511c642352 req-81c2c48d-b1dc-4eb9-80d7-c9f90b3ebea0 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:11.916162 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-3cb9c240-8b04-443f-92a7-8b511c642352 req-81c2c48d-b1dc-4eb9-80d7-c9f90b3ebea0 service nova] Creating event network-changed:e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4 for instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e on hv-cinder-84212 May 17 16:02:11.921218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-3cb9c240-8b04-443f-92a7-8b511c642352 req-81c2c48d-b1dc-4eb9-80d7-c9f90b3ebea0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086737 May 17 16:02:11.922052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 578/1158] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:02:13.022421 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1771266386", "imageRef": "70cc9197-a5db-4b2c-9655-e37f9a157427", "flavorRef": "452", "networks": [{"uuid": "c338d75b-ea08-46a5-8585-b0871783daf7"}]}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:13.073857 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] validate_networks() for [('c338d75b-ea08-46a5-8585-b0871783daf7', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 16:02:13.513940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 16:02:13.514464 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 16:02:13.514949 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 16:02:13.515366 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 16:02:13.515785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 16:02:13.524877 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:13.525463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:13.526324 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:13.526771 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:13.543641 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Getting quotas for project e2d2f895d6cb4e218216aa316538d046. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 16:02:13.547593 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Getting quotas for user 67020a523bd14f3689b3349492c90337 and project e2d2f895d6cb4e218216aa316538d046. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 16:02:13.558459 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 16:02:13.560668 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='70cc9197-a5db-4b2c-9655-e37f9a157427',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 16:02:13.606270 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-b021d4ab-6ea8-4f46-9df6-b8f5d5fa2a1a tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587648 May 17 16:02:13.607184 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 581/1159] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 16:02:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 16:02:13.617357 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8ad07080-da40-4c3b-b646-c9bfd842e7eb tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:13.618170 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-8ad07080-da40-4c3b-b646-c9bfd842e7eb tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:13.671000 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-8ad07080-da40-4c3b-b646-c9bfd842e7eb tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:13.677913 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8ad07080-da40-4c3b-b646-c9bfd842e7eb tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1219 microversion: 2.1 time: 0.064641 May 17 16:02:13.678511 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 579/1160] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:13 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:14.696085 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:14.696741 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:14.704371 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:14.704823 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:14.705617 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:14.706117 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:14.797845 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:14.805182 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-1ac60a13-ee3c-4c5c-bb8a-fa11c21f5f8d tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1277 microversion: 2.1 time: 0.113685 May 17 16:02:14.805760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 582/1161] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:14 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:15.760873 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-b918c680-b820-41b9-9b7b-295b91614bbd req-bb184908-1058-4fd1-bde9-71d56bccf44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9dd1f9d-20cb-4c11-b740-f51674616cd1", "tag": "635f628b-6188-47c5-bef1-f3a4dbb0375e"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:15.770865 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-b918c680-b820-41b9-9b7b-295b91614bbd req-bb184908-1058-4fd1-bde9-71d56bccf44f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:15.771334 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-b918c680-b820-41b9-9b7b-295b91614bbd req-bb184908-1058-4fd1-bde9-71d56bccf44f service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:15.782141 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-b918c680-b820-41b9-9b7b-295b91614bbd req-bb184908-1058-4fd1-bde9-71d56bccf44f service nova] Creating event network-changed:635f628b-6188-47c5-bef1-f3a4dbb0375e for instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 on hv-cinder-84212 May 17 16:02:15.787154 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-b918c680-b820-41b9-9b7b-295b91614bbd req-bb184908-1058-4fd1-bde9-71d56bccf44f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030607 May 17 16:02:15.787751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 580/1162] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 16:02:15.823834 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:15.824475 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:15.831644 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:15.832098 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:15.833134 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:15.833575 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:16.064614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:16.072774 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6cc51f61-f57f-4b6c-8c8b-ce187b950860 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1319 microversion: 2.1 time: 0.253014 May 17 16:02:16.073361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 583/1163] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:15 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 16:02:17.090433 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:17.091148 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:17.097295 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:17.097739 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:17.098571 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:17.099002 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:17.231200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:17.239280 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-9f13e516-5605-485c-b083-8d22099d8e00 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1319 microversion: 2.1 time: 0.152967 May 17 16:02:17.239845 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 581/1164] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:17 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:18.256738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:18.257347 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:18.263730 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:18.264173 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:18.264936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:18.265373 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:18.389430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:18.396640 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6fc31479-8f95-4975-97d6-a5d6f0560aa9 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1319 microversion: 2.1 time: 0.144460 May 17 16:02:18.397201 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 584/1165] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:18 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:19.413227 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:19.413849 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:19.420651 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:19.421102 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:19.421909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:19.422372 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:19.550423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:19.560643 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a39bf343-4963-43d7-b3c2-c23b0511506b tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1319 microversion: 2.1 time: 0.151219 May 17 16:02:19.561412 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 582/1166] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:19 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:20.561248 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-01eebf33-2768-44dc-9f29-f61403c93fab req-1415a1a5-e1b1-4ae4-ba4e-95db0ccbe7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9dd1f9d-20cb-4c11-b740-f51674616cd1", "name": "network-vif-plugged", "status": "completed", "tag": "635f628b-6188-47c5-bef1-f3a4dbb0375e"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:20.570576 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-01eebf33-2768-44dc-9f29-f61403c93fab req-1415a1a5-e1b1-4ae4-ba4e-95db0ccbe7b9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:20.571075 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-01eebf33-2768-44dc-9f29-f61403c93fab req-1415a1a5-e1b1-4ae4-ba4e-95db0ccbe7b9 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:20.580915 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:20.581528 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:20.583012 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-01eebf33-2768-44dc-9f29-f61403c93fab req-1415a1a5-e1b1-4ae4-ba4e-95db0ccbe7b9 service nova] Creating event network-vif-plugged:635f628b-6188-47c5-bef1-f3a4dbb0375e for instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 on hv-cinder-84212 May 17 16:02:20.588153 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-01eebf33-2768-44dc-9f29-f61403c93fab req-1415a1a5-e1b1-4ae4-ba4e-95db0ccbe7b9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030818 May 17 16:02:20.589038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 585/1167] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:02:20.590200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:20.590651 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:20.591421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:20.591856 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:20.736731 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:20.744653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4a7185c8-cb4b-4d57-8bd7-f9bbc4a9e992 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1319 microversion: 2.1 time: 0.167735 May 17 16:02:20.745223 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 583/1168] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:20 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 16:02:21.762508 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:21.763203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:21.769352 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:21.770323 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:21.771738 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:21.772240 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:21.905063 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:21.912400 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c381eaa3-4594-40c2-919f-78301aa53864 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1319 microversion: 2.1 time: 0.154623 May 17 16:02:21.912977 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 586/1169] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:21 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:22.930973 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:22.931584 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:22.938636 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:22.939522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:22.940289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:22.940725 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:23.063103 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:23.071212 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c790fc90-d111-4f26-bf2b-69b0278d95a8 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1509 microversion: 2.1 time: 0.144999 May 17 16:02:23.071780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 584/1170] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:22 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:23.087321 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "428bdc7a-7e31-4595-8f34-ebb55bfd0bdb", "device": "/dev/sdb"}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:23.088422 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:23.094757 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:23.095207 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:23.095976 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:23.096415 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:23.349325 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-0a339462-ade1-44e6-a0f6-11ad29222aa3 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "POST /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265704 May 17 16:02:23.349939 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 587/1171] 10.222.0.75 () {60 vars in 1322 bytes} [Tue May 17 16:02:23 2022] POST /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:02:45.664988 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:45.665555 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:45.671496 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:45.671948 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:45.672714 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:45.673153 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:45.750979 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lazy-loading 'services' on Instance uuid a9dd1f9d-20cb-4c11-b740-f51674616cd1 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:02:45.820487 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-765214b6-610f-4a33-8879-0e9c570e24cc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1/os-volume_attachments/428bdc7a-7e31-4595-8f34-ebb55bfd0bdb" status: 202 len: 0 microversion: 2.1 time: 0.159402 May 17 16:02:45.821089 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 585/1172] 10.222.0.75 () {58 vars in 1415 bytes} [Tue May 17 16:02:45 2022] DELETE /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1/os-volume_attachments/428bdc7a-7e31-4595-8f34-ebb55bfd0bdb => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 16:02:46.928474 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:46.929067 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:46.935245 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:46.935701 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:46.936470 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:46.936910 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:46.961078 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Going to try to terminate instance {{(pid=123909) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 16:02:47.032343 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-a6788842-8b67-4050-87fa-f46f781e36f7 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 204 len: 0 microversion: 2.1 time: 0.108895 May 17 16:02:47.032927 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 588/1173] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:02:46 2022] DELETE /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 16:02:47.048663 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:47.049380 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:47.056793 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:47.057251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:47.058052 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:47.058497 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:47.192191 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:47.199522 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-48769119-0549-443c-a1ff-882807d91883 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1515 microversion: 2.1 time: 0.155473 May 17 16:02:47.200086 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 586/1174] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:47 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:48.217125 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:48.217866 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:48.224228 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:48.224690 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:48.225463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:48.225905 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:48.354082 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:48.361573 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-e6d9ca40-9b0f-4c3c-9b04-8c886e72d5b1 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1515 microversion: 2.1 time: 0.148692 May 17 16:02:48.362165 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 589/1175] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:48 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:02:49.292575 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-fd851987-2652-4c9b-abf4-4eef4ebca6b2 req-35386fba-8385-4f4b-9357-46aa71f1266c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9dd1f9d-20cb-4c11-b740-f51674616cd1", "name": "network-vif-deleted", "tag": "635f628b-6188-47c5-bef1-f3a4dbb0375e"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:02:49.302317 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-fd851987-2652-4c9b-abf4-4eef4ebca6b2 req-35386fba-8385-4f4b-9357-46aa71f1266c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:49.302768 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-fd851987-2652-4c9b-abf4-4eef4ebca6b2 req-35386fba-8385-4f4b-9357-46aa71f1266c service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:49.314218 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-fd851987-2652-4c9b-abf4-4eef4ebca6b2 req-35386fba-8385-4f4b-9357-46aa71f1266c service nova] Creating event network-vif-deleted:635f628b-6188-47c5-bef1-f3a4dbb0375e for instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 on hv-cinder-84212 May 17 16:02:49.319018 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-fd851987-2652-4c9b-abf4-4eef4ebca6b2 req-35386fba-8385-4f4b-9357-46aa71f1266c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 May 17 16:02:49.319611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 587/1176] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:02:49.379677 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:49.380429 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:49.386483 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:49.386942 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:49.387735 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:49.388193 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:49.420429 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:49.420802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:49.421259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.objects.instance [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lazy-loading 'fault' on Instance uuid a9dd1f9d-20cb-4c11-b740-f51674616cd1 {{(pid=123909) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:02:49.461599 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67020a523bd14f3689b3349492c90337', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2d2f895d6cb4e218216aa316538d046', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:02:49.468853 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ea358b89-eea6-453f-8884-b61906627bdc tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 200 len: 1309 microversion: 2.1 time: 0.093613 May 17 16:02:49.469420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 590/1177] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:49 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 16:02:50.487909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:02:50.488525 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] [instance: a9dd1f9d-20cb-4c11-b740-f51674616cd1] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:02:50.495336 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:50.495780 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:50.496535 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:02:50.496966 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:02:50.511095 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] HTTP exception thrown: Instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 could not be found. May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Request method failure captured: May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 HTTP/1.1 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8a37qv_n2yhwx-jXGb5K2PwRpNVp4AbMUbYSzk7k1xhMUt1RYQqAccGBTXI0vWRRkjwc1vvhQ7YHsmZjxHRhCTpAB1vrZlyg1savhGCQK0mNPezVMe8Ennb2PYq42b63NKV4KGdh-X6D352hOO7HVVwrrNKVFnLmP48iJO7123P6O8 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: e2d2f895d6cb4e218216aa316538d046 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-VolumesSnapshotTestJSON-436094553 May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:02:50.512706 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e2d2f895d6cb4e218216aa316538d046"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_e2d2f895d6cb4e218216aa316538d046"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/e2d2f895d6cb4e218216aa316538d046"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/e2d2f895d6cb4e218216aa316538d046"}]}] May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-VolumesSnapshotTestJSON-436094553 May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: e2d2f895d6cb4e218216aa316538d046 May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-436094553 May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-VolumesSnapshotTestJSON-436094553-project May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 67020a523bd14f3689b3349492c90337 May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-VolumesSnapshotTestJSON-436094553-project May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 could not be found. May 17 16:02:50.514423 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': 'a9dd1f9d-20cb-4c11-b740-f51674616cd1'} May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 could not be found. May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:02:50.515289 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 could not be found. May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 could not be found. May 17 16:02:50.516639 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:02:50.517857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] Returning 404 to user: Instance a9dd1f9d-20cb-4c11-b740-f51674616cd1 could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:02:50.517857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-964753a0-07b2-4b52-9195-4138916dc9a4 tempest-VolumesSnapshotTestJSON-436094553 tempest-VolumesSnapshotTestJSON-436094553-project] 10.222.0.75 "GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1" status: 404 len: 111 microversion: 2.1 time: 0.031731 May 17 16:02:50.517857 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 588/1178] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:02:50 2022] GET /compute/v2.1/servers/a9dd1f9d-20cb-4c11-b740-f51674616cd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:03:40.281716 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:03:40.282448 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 16:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:04:28.115565 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1511759857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-327864240", "security_groups": [{"name": "tempest-secgroup-smoke-252411881"}], "block_device_mapping_v2": [{"uuid": "07d8eda4-0793-4407-a129-4ae5c6d61494", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6f4eb954-5185-441c-9dd5-cd8454980b48"}]}} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:04:28.124700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e12aa146-55ba-4bbc-81f9-ceef402b7428] AMQP server on 10.222.0.75:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 16:04:28.223502 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.network.neutron [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] validate_networks() for [('6f4eb954-5185-441c-9dd5-cd8454980b48', None, None, None, None, None)] {{(pid=123909) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 16:04:28.595259 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Flavor limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 16:04:28.595699 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Image limits 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 16:04:28.596178 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Flavor pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 16:04:28.596623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Image pref 0:0:0 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 16:04:28.597038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.virt.hardware [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123909) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 16:04:28.605686 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:28.606195 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:28.607010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:28.607700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:28.623845 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for project fbe368679f4c4d968619ea0e2456c407. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 16:04:28.627816 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.quota [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Getting quotas for user 3df48c5aad0f4cb5aeb7c76d82ab0b4b and project fbe368679f4c4d968619ea0e2456c407. Resources: {'cores', 'instances', 'ram'} {{(pid=123909) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 16:04:28.683409 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Going to run 1 instances... {{(pid=123909) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 16:04:28.685496 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07d8eda4-0793-4407-a129-4ae5c6d61494',volume_size=None,volume_type=None)] {{(pid=123909) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 16:04:28.808364 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-c786f69e-8b51-4c4a-8b9f-f3d0e706e01e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697069 May 17 16:04:28.809005 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 591/1179] 10.222.0.75 () {60 vars in 1146 bytes} [Tue May 17 16:04:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 16:04:28.820620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-50200394-b9cc-4800-a487-bb0a6c6b4703 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:28.821620 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-50200394-b9cc-4800-a487-bb0a6c6b4703 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:28.986472 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-50200394-b9cc-4800-a487-bb0a6c6b4703 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:28.994501 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-50200394-b9cc-4800-a487-bb0a6c6b4703 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1094 microversion: 2.1 time: 0.179240 May 17 16:04:28.994801 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 589/1180] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:28 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1094 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:30.012102 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:30.012689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:30.020966 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:30.021420 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:30.022238 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:30.022680 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:30.023929 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] [e12aa146-55ba-4bbc-81f9-ceef402b7428] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 60528. May 17 16:04:30.162813 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:30.172974 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-ffb2cba1-84f5-417d-8b8c-971d2316c08a tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1210 microversion: 2.1 time: 0.166448 May 17 16:04:30.184126 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 592/1181] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:30 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:31.199794 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:31.200421 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:31.207165 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:31.207611 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:31.208396 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:31.208836 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:31.438748 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:31.447530 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-6a7fd2ec-30ec-46f0-b416-67cb0873a14f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.252263 May 17 16:04:31.457073 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 590/1182] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:31 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:31.473147 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-4006a8ee-d066-4193-a12d-b7bb8683ea3e req-6c7c216c-2d7e-4ec9-889c-d3e3f3453fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d36e836-ea99-440f-bd1f-e2166f778e34", "tag": "3f1c9000-c43e-43d5-9034-492b700069c9"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:04:31.482172 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-4006a8ee-d066-4193-a12d-b7bb8683ea3e req-6c7c216c-2d7e-4ec9-889c-d3e3f3453fba service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:31.482881 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-4006a8ee-d066-4193-a12d-b7bb8683ea3e req-6c7c216c-2d7e-4ec9-889c-d3e3f3453fba service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:31.495843 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-4006a8ee-d066-4193-a12d-b7bb8683ea3e req-6c7c216c-2d7e-4ec9-889c-d3e3f3453fba service nova] Creating event network-changed:3f1c9000-c43e-43d5-9034-492b700069c9 for instance 9d36e836-ea99-440f-bd1f-e2166f778e34 on hv-cinder-84212 May 17 16:04:31.500982 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-4006a8ee-d066-4193-a12d-b7bb8683ea3e req-6c7c216c-2d7e-4ec9-889c-d3e3f3453fba service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126218 May 17 16:04:31.501760 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 593/1183] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:04:32.465209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:32.465791 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:32.472094 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:32.472542 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:32.473297 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:32.473727 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:32.605745 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:32.613209 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-4147f448-f2ee-4c36-b451-d55d9dba0291 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.151941 May 17 16:04:32.613767 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 591/1184] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:32 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:33.630718 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:33.631430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:33.638123 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:33.638584 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:33.639356 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:33.639802 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:33.771001 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:33.778940 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3593facf-25bc-4f3c-b4ad-a45ce68ce5c0 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.152976 May 17 16:04:33.779513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 594/1185] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:33 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:34.795889 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:34.796754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:34.804123 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:34.804570 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:34.805355 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:34.805790 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:34.933041 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:34.940290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-08b52c4e-e176-4081-8230-8c515430c658 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.148397 May 17 16:04:34.940862 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 592/1186] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:34 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:35.956591 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:35.957203 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:35.964236 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:35.964684 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:35.965451 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:35.965883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:36.094992 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:36.102316 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-3f188f9d-b9d6-4b24-a53f-8b98b2f43aea tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.149564 May 17 16:04:36.103010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 595/1187] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:35 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:37.118488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:37.119103 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:37.125068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:37.125514 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:37.126302 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:37.126738 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:37.253631 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:37.260951 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-854ca382-2291-4850-8c83-304b166b4e23 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.146524 May 17 16:04:37.261512 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 593/1188] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:37 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:38.277965 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:38.278612 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:38.285004 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:38.285458 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:38.286256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:38.286700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:38.411469 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:38.418826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-87381ecd-e504-4e9a-ac0c-751959b8fd8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.144708 May 17 16:04:38.419393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 596/1189] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:38 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:39.435548 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:39.436126 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:39.442280 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:39.442734 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:39.443509 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:39.443946 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:39.577520 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:39.588593 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-02b01f97-15c9-4e1a-adc3-7af28dd81992 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.156901 May 17 16:04:39.589200 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 594/1190] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:39 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:40.611068 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:40.611691 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:40.618743 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:40.619199 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:40.619976 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:40.620418 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:40.747604 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:40.754904 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-06afa93a-95c1-425b-9ecc-4bfa645c9127 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.148053 May 17 16:04:40.755485 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 597/1191] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:40 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:41.386508 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [req-dfad5d10-9cdf-4704-ae58-bee5bbacf6f2 req-33193a5a-a057-462d-b69c-dc323c0c94db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d36e836-ea99-440f-bd1f-e2166f778e34", "name": "network-vif-plugged", "status": "completed", "tag": "3f1c9000-c43e-43d5-9034-492b700069c9"}]} {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:04:41.395164 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-dfad5d10-9cdf-4704-ae58-bee5bbacf6f2 req-33193a5a-a057-462d-b69c-dc323c0c94db service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:41.395648 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [req-dfad5d10-9cdf-4704-ae58-bee5bbacf6f2 req-33193a5a-a057-462d-b69c-dc323c0c94db service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:41.407109 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.compute.server_external_events [req-dfad5d10-9cdf-4704-ae58-bee5bbacf6f2 req-33193a5a-a057-462d-b69c-dc323c0c94db service nova] Creating event network-vif-plugged:3f1c9000-c43e-43d5-9034-492b700069c9 for instance 9d36e836-ea99-440f-bd1f-e2166f778e34 on hv-cinder-84212 May 17 16:04:41.411963 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [req-dfad5d10-9cdf-4704-ae58-bee5bbacf6f2 req-33193a5a-a057-462d-b69c-dc323c0c94db service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029744 May 17 16:04:41.412545 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 595/1192] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:04:41.771521 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:41.772256 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:41.778642 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:41.779102 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:41.779883 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:41.780513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:41.909344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:41.917285 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-28b9db8d-f352-4603-8ce0-d5d0910d7893 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.149633 May 17 16:04:41.917854 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 598/1193] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:41 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:42.935536 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:42.936282 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:42.942468 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:42.942997 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:42.943712 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:42.944134 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:43.073605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:43.081068 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-60b428c7-1995-4cf3-a524-8fb60aab76d3 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1265 microversion: 2.1 time: 0.150227 May 17 16:04:43.081633 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 596/1194] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:42 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:44.098513 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:44.099155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:44.105590 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:44.106074 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:44.106851 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:44.107304 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:44.235700 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:44.243300 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-dd0ba21f-516a-478d-917e-5c689750bab8 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1451 microversion: 2.1 time: 0.148710 May 17 16:04:44.243871 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 599/1195] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:44 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:44.259863 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:04:44.260481 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:04:44.266901 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:44.267350 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:44.268125 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:44.268559 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:44.398186 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:04:44.406038 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a41dc145-7fc5-4745-ba29-77c57ca8e5a6 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1451 microversion: 2.1 time: 0.150583 May 17 16:04:44.406605 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 597/1196] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:04:44 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:04:46.130610 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-b8da6230-9d7b-42cc-ac1a-91942ab4ce4d req-078d85c9-d112-44db-b50b-8dfc1abba865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d36e836-ea99-440f-bd1f-e2166f778e34", "tag": "3f1c9000-c43e-43d5-9034-492b700069c9"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:04:46.139375 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b8da6230-9d7b-42cc-ac1a-91942ab4ce4d req-078d85c9-d112-44db-b50b-8dfc1abba865 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:04:46.139826 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b8da6230-9d7b-42cc-ac1a-91942ab4ce4d req-078d85c9-d112-44db-b50b-8dfc1abba865 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:04:46.151357 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-b8da6230-9d7b-42cc-ac1a-91942ab4ce4d req-078d85c9-d112-44db-b50b-8dfc1abba865 service nova] Creating event network-changed:3f1c9000-c43e-43d5-9034-492b700069c9 for instance 9d36e836-ea99-440f-bd1f-e2166f778e34 on hv-cinder-84212 May 17 16:04:46.157027 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-b8da6230-9d7b-42cc-ac1a-91942ab4ce4d req-078d85c9-d112-44db-b50b-8dfc1abba865 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030482 May 17 16:04:46.157654 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 600/1197] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:05:13.667911 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:05:13.668614 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 16:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:05:22.652482 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:05:22.653090 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 16:05:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:06:36.039644 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [63cb2117-3a66-417d-8f18-2afe85fe7ae6] AMQP server on 10.222.0.75:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 16:06:36.043488 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:36.043993 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:36.045623 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-6868fc47-475a-4146-ab68-59e4ed180407 req-48c2fd19-c915-4849-ad23-61bf858044b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d36e836-ea99-440f-bd1f-e2166f778e34", "tag": "3f1c9000-c43e-43d5-9034-492b700069c9"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:06:36.051332 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:36.052054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:36.053054 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:36.053696 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:36.053822 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-6868fc47-475a-4146-ab68-59e4ed180407 req-48c2fd19-c915-4849-ad23-61bf858044b4 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:36.054244 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-6868fc47-475a-4146-ab68-59e4ed180407 req-48c2fd19-c915-4849-ad23-61bf858044b4 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:36.065909 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-6868fc47-475a-4146-ab68-59e4ed180407 req-48c2fd19-c915-4849-ad23-61bf858044b4 service nova] Creating event network-changed:3f1c9000-c43e-43d5-9034-492b700069c9 for instance 9d36e836-ea99-440f-bd1f-e2166f778e34 on hv-cinder-84212 May 17 16:06:36.071336 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-6868fc47-475a-4146-ab68-59e4ed180407 req-48c2fd19-c915-4849-ad23-61bf858044b4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030936 May 17 16:06:36.072840 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 601/1198] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 16:06:36.086788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 16:06:36.182042 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-24c79604-394c-45cb-a9d0-762c53c4d1e5 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 204 len: 0 microversion: 2.1 time: 0.143400 May 17 16:06:36.183474 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 598/1199] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:06:36 2022] DELETE /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 16:06:36.192251 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:36.193236 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:36.200312 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:36.201038 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:36.202064 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:36.202712 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:36.355393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:06:36.363079 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-f78242ee-caac-4eb3-b5d2-6f10d7468146 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1576 microversion: 2.1 time: 0.175278 May 17 16:06:36.363646 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 602/1200] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:36 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:06:37.387177 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:37.387784 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:37.399656 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] [63cb2117-3a66-417d-8f18-2afe85fe7ae6] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 60622. May 17 16:06:37.406265 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:37.406751 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:37.408477 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:37.408932 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:37.625568 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:06:37.633407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-f506011c-fb9a-45d4-9be7-76cfd78fe437 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1576 microversion: 2.1 time: 0.251096 May 17 16:06:37.634021 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 599/1201] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:37 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:06:38.281964 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-cf6c00f3-4e7d-429e-9f34-19e71dac568b req-a10e1e56-af15-4a89-96cf-df9777904e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d36e836-ea99-440f-bd1f-e2166f778e34", "name": "network-vif-deleted", "tag": "3f1c9000-c43e-43d5-9034-492b700069c9"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:06:38.292106 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-cf6c00f3-4e7d-429e-9f34-19e71dac568b req-a10e1e56-af15-4a89-96cf-df9777904e72 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:38.292559 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-cf6c00f3-4e7d-429e-9f34-19e71dac568b req-a10e1e56-af15-4a89-96cf-df9777904e72 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:38.303846 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-cf6c00f3-4e7d-429e-9f34-19e71dac568b req-a10e1e56-af15-4a89-96cf-df9777904e72 service nova] Creating event network-vif-deleted:3f1c9000-c43e-43d5-9034-492b700069c9 for instance 9d36e836-ea99-440f-bd1f-e2166f778e34 on hv-cinder-84212 May 17 16:06:38.309747 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-cf6c00f3-4e7d-429e-9f34-19e71dac568b req-a10e1e56-af15-4a89-96cf-df9777904e72 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 May 17 16:06:38.311100 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 603/1202] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:06:38.651217 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:38.651842 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:38.658653 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:38.659197 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:38.660081 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:38.660518 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:38.693443 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:38.693896 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:38.694384 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lazy-loading 'fault' on Instance uuid 9d36e836-ea99-440f-bd1f-e2166f778e34 {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:06:38.735359 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:06:38.742909 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a55ba982-d546-4710-9aa4-1d837310c270 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 200 len: 1230 microversion: 2.1 time: 0.095783 May 17 16:06:38.743506 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 600/1203] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:38 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:06:39.761372 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:39.762108 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 9d36e836-ea99-440f-bd1f-e2166f778e34] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:39.768766 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:39.769223 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:39.770010 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:39.770463 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:39.784621 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] HTTP exception thrown: Instance 9d36e836-ea99-440f-bd1f-e2166f778e34 could not be found. May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Request method failure captured: May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 HTTP/1.1 May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8Yjw-Z9vHYf1lqbQmseMqFA_f8jT6xOlAaaJBw90HVo41jPvaQqV-1M_ryhOfRSYlrYe9yixjH_ikPoeXaTlO-5DKQnTo4bwB2TO6rgZj7STrUWBA-xWo2ejixx4Zi0TgFq-p5rNb0DDIHIqKXnaOr2TWVzp-Ys2XyKvgGLQS-FDYo May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:06:39.786629 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fbe368679f4c4d968619ea0e2456c407"}]}] May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 3df48c5aad0f4cb5aeb7c76d82ab0b4b May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 9d36e836-ea99-440f-bd1f-e2166f778e34 could not be found. May 17 16:06:39.788414 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '9d36e836-ea99-440f-bd1f-e2166f778e34'} May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d36e836-ea99-440f-bd1f-e2166f778e34 could not be found. May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:06:39.789594 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d36e836-ea99-440f-bd1f-e2166f778e34 could not be found. May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d36e836-ea99-440f-bd1f-e2166f778e34 could not be found. May 17 16:06:39.792112 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:39.793660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Returning 404 to user: Instance 9d36e836-ea99-440f-bd1f-e2166f778e34 could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:06:39.793660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-22c79808-68a3-4cb1-9821-cd6331ec37c7 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34" status: 404 len: 111 microversion: 2.1 time: 0.030913 May 17 16:06:39.793660 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 604/1204] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:39 2022] GET /compute/v2.1/servers/9d36e836-ea99-440f-bd1f-e2166f778e34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:06:42.791093 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:42.791618 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:42.793689 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-20e1b50a-8aec-4234-8aba-2725b95942c9 req-fe8cc98c-6cac-4a14-ba51-e2ffaa7ccbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c6b3b9-82e1-42fa-9a41-bb5a2579607e", "tag": "e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:06:42.798050 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:42.798753 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:42.799525 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:42.799954 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:42.802144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-20e1b50a-8aec-4234-8aba-2725b95942c9 req-fe8cc98c-6cac-4a14-ba51-e2ffaa7ccbc1 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:42.802785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-20e1b50a-8aec-4234-8aba-2725b95942c9 req-fe8cc98c-6cac-4a14-ba51-e2ffaa7ccbc1 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:42.814766 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-20e1b50a-8aec-4234-8aba-2725b95942c9 req-fe8cc98c-6cac-4a14-ba51-e2ffaa7ccbc1 service nova] Creating event network-changed:e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4 for instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e on hv-cinder-84212 May 17 16:06:42.820337 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-20e1b50a-8aec-4234-8aba-2725b95942c9 req-fe8cc98c-6cac-4a14-ba51-e2ffaa7ccbc1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030544 May 17 16:06:42.821242 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 605/1205] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:06:42.826754 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Going to try to terminate instance {{(pid=123908) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 16:06:42.916051 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-14cf00af-047f-49ae-9163-8d157e8e274f tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "DELETE /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 204 len: 0 microversion: 2.1 time: 0.128205 May 17 16:06:42.917155 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 601/1206] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:06:42 2022] DELETE /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 16:06:42.926651 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:42.927804 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:42.934902 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:42.935361 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:42.936151 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:42.936593 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:43.081900 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.policy [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123909) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:06:43.089566 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-422c702f-0d82-41a6-a1c8-b64ecffb9f8c tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1576 microversion: 2.1 time: 0.167676 May 17 16:06:43.090174 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 606/1207] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:42 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:06:44.106516 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:44.107313 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:44.114028 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:44.114490 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:44.115271 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:44.115709 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:44.244809 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:06:44.252219 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-c9733ef2-8241-4bc1-ace4-d0007726d3b9 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1576 microversion: 2.1 time: 0.149920 May 17 16:06:44.252778 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 602/1208] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:44 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:06:44.927090 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [req-b82924c3-01f1-45ee-8137-557658160f44 req-06b21222-ba95-4ba9-8e05-45310ecd6a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c6b3b9-82e1-42fa-9a41-bb5a2579607e", "name": "network-vif-deleted", "tag": "e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4"}]} {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 16:06:44.936155 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b82924c3-01f1-45ee-8137-557658160f44 req-06b21222-ba95-4ba9-8e05-45310ecd6a27 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:44.936603 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [req-b82924c3-01f1-45ee-8137-557658160f44 req-06b21222-ba95-4ba9-8e05-45310ecd6a27 service nova] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:44.953794 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.compute.server_external_events [req-b82924c3-01f1-45ee-8137-557658160f44 req-06b21222-ba95-4ba9-8e05-45310ecd6a27 service nova] Creating event network-vif-deleted:e9fe0496-5a0f-4d33-ae6e-bbfc4d3d4ac4 for instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e on hv-cinder-84212 May 17 16:06:44.958473 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [req-b82924c3-01f1-45ee-8137-557658160f44 req-06b21222-ba95-4ba9-8e05-45310ecd6a27 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035007 May 17 16:06:44.959059 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 607/1209] 10.222.0.75 () {64 vars in 1317 bytes} [Tue May 17 16:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 16:06:45.269822 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:45.270473 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:45.277251 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:45.277708 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:45.278525 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:45.279017 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:45.316526 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:45.316980 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:45.317569 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.objects.instance [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lazy-loading 'fault' on Instance uuid 26c6b3b9-82e1-42fa-9a41-bb5a2579607e {{(pid=123908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 16:06:45.359776 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.policy [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3df48c5aad0f4cb5aeb7c76d82ab0b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe368679f4c4d968619ea0e2456c407', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123908) authorize /opt/stack/nova/nova/policy.py:199}} May 17 16:06:45.367239 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-79d5f386-f8eb-43a6-919a-6538a3c12983 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 200 len: 1230 microversion: 2.1 time: 0.101314 May 17 16:06:45.367743 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 603/1210] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:45 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 16:06:46.385269 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:46.386512 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 26c6b3b9-82e1-42fa-9a41-bb5a2579607e] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:46.392737 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:46.393188 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:46.393961 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:46.394430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:46.408806 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] HTTP exception thrown: Instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e could not be found. May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Request method failure captured: May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e HTTP/1.1 May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8Yjw-Z9vHYf1lqbQmseMqFA_f8jT6xOlAaaJBw90HVo41jPvaQqV-1M_ryhOfRSYlrYe9yixjH_ikPoeXaTlO-5DKQnTo4bwB2TO6rgZj7STrUWBA-xWo2ejixx4Zi0TgFq-p5rNb0DDIHIqKXnaOr2TWVzp-Ys2XyKvgGLQS-FDYo May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:06:46.411430 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fbe368679f4c4d968619ea0e2456c407"}]}] May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 3df48c5aad0f4cb5aeb7c76d82ab0b4b May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e could not be found. May 17 16:06:46.413150 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '26c6b3b9-82e1-42fa-9a41-bb5a2579607e'} May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e could not be found. May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:06:46.414144 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e could not be found. May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e could not be found. May 17 16:06:46.415755 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.418262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Returning 404 to user: Instance 26c6b3b9-82e1-42fa-9a41-bb5a2579607e could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:06:46.418262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-6a5afb6a-5b01-4f86-b86c-6bc35c5700c1 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e" status: 404 len: 111 microversion: 2.1 time: 0.033067 May 17 16:06:46.418262 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 608/1211] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:46 2022] GET /compute/v2.1/servers/26c6b3b9-82e1-42fa-9a41-bb5a2579607e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:06:46.846360 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:46.846850 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.compute.api [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123908) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:46.853035 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:46.853479 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:46.854761 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:46.855188 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG oslo_concurrency.lockutils [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:46.868310 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.wsgi [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] HTTP exception thrown: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Request method failure captured: May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: request: DELETE /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f HTTP/1.1 May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept: application/json May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Accept-Encoding: identity May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Connection: close May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Length: 0 May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Content-Type: application/json May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Host: 10.222.0.75 May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Openstack-System-Scope: None May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: User-Agent: python-urllib3/1.26.9 May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Auth-Token: gAAAAABig8Yjw-Z9vHYf1lqbQmseMqFA_f8jT6xOlAaaJBw90HVo41jPvaQqV-1M_ryhOfRSYlrYe9yixjH_ikPoeXaTlO-5DKQnTo4bwB2TO6rgZj7STrUWBA-xWo2ejixx4Zi0TgFq-p5rNb0DDIHIqKXnaOr2TWVzp-Ys2XyKvgGLQS-FDYo May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Id: None May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Domain-Name: None May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Identity-Status: Confirmed May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Is-Admin-Project: True May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Id: default May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Domain-Name: Default May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Project-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Role: reader,member May 17 16:06:46.870563 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Roles: reader,member May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fbe368679f4c4d968619ea0e2456c407"}]}] May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-Tenant-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Id: default May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Domain-Name: Default May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Id: 3df48c5aad0f4cb5aeb7c76d82ab0b4b May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: X-User-Name: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: method: > May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: exception: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.872290 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: action_args: {'id': '453bba5c-49db-439a-8ff8-095ff05a6d3f'} May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:06:46.873270 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.874906 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: ERROR nova.api.openstack.wsgi May 17 16:06:46.876544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Returning 404 to user: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. {{(pid=123908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:06:46.876544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-a0779c9c-8c28-4200-a2b5-6b6ec92fa48e tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "DELETE /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 404 len: 111 microversion: 2.1 time: 0.029526 May 17 16:06:46.876544 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 604/1212] 10.222.0.75 () {58 vars in 1238 bytes} [Tue May 17 16:06:46 2022] DELETE /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:06:46.880356 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '>' {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:46.880970 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.compute.api [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] [instance: 453bba5c-49db-439a-8ff8-095ff05a6d3f] Fetching instance by UUID {{(pid=123909) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 16:06:46.886998 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:46.887450 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:46.888212 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 16:06:46.888650 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG oslo_concurrency.lockutils [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Lock "91629321-da27-4ee4-9a78-15344e4578f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 16:06:46.902030 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.wsgi [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] HTTP exception thrown: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Request method failure captured: May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: request: GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f HTTP/1.1 May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept: application/json May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Accept-Encoding: identity May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Connection: close May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Length: 0 May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Content-Type: application/json May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Host: 10.222.0.75 May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Openstack-System-Scope: None May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: User-Agent: python-urllib3/1.26.9 May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Auth-Token: gAAAAABig8Yjw-Z9vHYf1lqbQmseMqFA_f8jT6xOlAaaJBw90HVo41jPvaQqV-1M_ryhOfRSYlrYe9yixjH_ikPoeXaTlO-5DKQnTo4bwB2TO6rgZj7STrUWBA-xWo2ejixx4Zi0TgFq-p5rNb0DDIHIqKXnaOr2TWVzp-Ys2XyKvgGLQS-FDYo May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Id: None May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Domain-Name: None May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Identity-Status: Confirmed May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Is-Admin-Project: True May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Id: default May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Domain-Name: Default May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Project-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Role: reader,member May 17 16:06:46.903579 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Roles: reader,member May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fbe368679f4c4d968619ea0e2456c407"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fbe368679f4c4d968619ea0e2456c407"}]}] May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Id: fbe368679f4c4d968619ea0e2456c407 May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-Tenant-Name: tempest-TestVolumeBootPattern-2025100078 May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Id: default May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Domain-Name: Default May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Id: 3df48c5aad0f4cb5aeb7c76d82ab0b4b May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: X-User-Name: tempest-TestVolumeBootPattern-2025100078-project May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: method: > May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: exception: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.905287 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: action_args: {'id': '453bba5c-49db-439a-8ff8-095ff05a6d3f'} May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: {{(pid=123909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 16:06:46.906344 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. May 17 16:06:46.907936 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: ERROR nova.api.openstack.wsgi May 17 16:06:46.909507 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: DEBUG nova.api.openstack.wsgi [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Returning 404 to user: Instance 453bba5c-49db-439a-8ff8-095ff05a6d3f could not be found. {{(pid=123909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 16:06:46.909507 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO nova.api.openstack.requestlog [None req-64627647-2a7f-45c4-93e3-fc4d4681d166 tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f" status: 404 len: 111 microversion: 2.1 time: 0.028433 May 17 16:06:46.909507 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: [pid: 123909|app: 0|req: 609/1213] 10.222.0.75 () {58 vars in 1235 bytes} [Tue May 17 16:06:46 2022] GET /compute/v2.1/servers/453bba5c-49db-439a-8ff8-095ff05a6d3f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 16:06:48.178537 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: DEBUG nova.api.openstack.wsgi [None req-8391e4eb-908e-4d38-b15d-86e47b1540de tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] Calling method '.version_select at 0x7f83f731a3a0>' {{(pid=123908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 16:06:48.201788 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO nova.api.openstack.requestlog [None req-8391e4eb-908e-4d38-b15d-86e47b1540de tempest-TestVolumeBootPattern-2025100078 tempest-TestVolumeBootPattern-2025100078-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-327864240" status: 202 len: 0 microversion: 2.1 time: 0.026953 May 17 16:06:48.202407 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: [pid: 123908|app: 0|req: 605/1214] 10.222.0.75 () {58 vars in 1259 bytes} [Tue May 17 16:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-327864240 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 16:07:00.289866 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:07:00.290703 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 16:07:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:07:11.743432 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:07:11.743980 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 16:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:08:33.676257 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:08:33.676939 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 16:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:10:20.298166 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:10:20.298819 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 16:10:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:10:31.751873 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:10:31.752393 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 16:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:11:53.684024 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:11:53.684785 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 16:11:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:12:02.664761 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:12:02.665345 dv-cinder-842128-1-iscsi devstack@n-api.service[123908]: Tue May 17 16:12:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 16:12:17.247232 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 16:12:17.247784 dv-cinder-842128-1-iscsi devstack@n-api.service[123909]: Tue May 17 16:12:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!